About Nesta

Nesta is an innovation foundation. For us, innovation means turning bold ideas into reality and changing lives for the better. We use our expertise, skills and funding in areas where there are big challenges facing society.

Executive summary

Executive summary

As Great Britain transitions to a low-carbon electricity system, demand-side flexibility is becoming increasingly important for managing the grid. The Demand Flexibility Service (DFS), introduced by National Grid ESO in 2022, rewards households for reducing electricity use at specified times. This report focuses on the experiences of smart prepayment meter customers participating in the energy supplier Utilita's ‘Power Payback’ DFS offering.

Prepayment customers, who make up around 4 million British households, are more likely to be on low incomes, renting, elderly, or disabled compared to credit customers. Understanding their experiences with flexibility services is crucial for ensuring an inclusive energy transition.

We conducted nine in-depth, online interviews with Utilita customers who had varying levels of engagement with Power Payback. This was complemented by a sentiment analysis of forum posts on the topic of the DFS more generally.

The main findings were as follows:

  • Financial savings were the main reason people decided to sign up, and they were generally happy even with low levels of savings (from less than a pound to nearly ten pounds overall) – there was a genuine sense that ‘every little helps’.
  • Participants also valued the learning opportunities (for themselves and their families), environmental benefits, and the opportunity to disconnect from routine.
  • People employed a range of actions to respond to DFS events (when they were asked to reduce consumption), with most turning off appliances, some shifting cooking times, and one turning off power for their whole home.
  • The presence of children and other caring responsibilities significantly influenced the ability to respond flexibly to events, mainly out of concern for disrupting schedules and routines around school and bedtimes.
  • However, due to their generally higher electricity use, larger households were able to make larger savings if they were able to shift.
  • Participants generally showed low levels of awareness about the underlying reasons for the DFS.
  • Views on flexibility products expected to become more common in future (like time of use tariffs) were mixed, with concerns about switching to unfamiliar products, and disruption to family routines.
  • While some groups (eg, single occupants and older people) were seen as potentially better able to benefit from flexibility, this wasn't generally viewed as unfair.

Based on the findings, we present a number of provisional personas (or fictionalised consumer representations) to inform our work in this area. These draw on different aspects of people’s experiences, including educating children, exploring an interest in energy, and taking opportunities to disconnect and vary routines. We also map out customer journeys for each of these personas, with initial suggestions for how they could be enhanced.

We suggest three main areas that should be prioritised for future focus:

  1. Promoting awareness: Given the low levels of flexibility that many prepayment customers can currently provide, at this stage in the low-carbon transition a greater emphasis should be placed on ways of effectively building awareness and understanding of the need for flexibility. We believe this will be important in expanding and accelerating participation in future flexibility services.
  2. Recognising reliability: Where households do show the potential to provide larger responses, we need to develop mechanisms to help them increase the reliability with which they may be able to respond. Reliability increases the overall value of flexibility for both the system and, if it is appropriately recognised, households.
  3. Building flexibility capital: We need to explore ways to increase the capacity to provide flexibility for a broader range of households, including through innovative business models and potential regulatory changes. Getting more flexibility, from a diverse range of sources, sooner, is likely to be key to enabling a quicker and more economical low-carbon transition.

Introduction

Introduction

Demand-side flexibility: why, how, and who?

In Great Britain, we are getting more of our electricity from renewable sources like solar and wind power. At the same time, we are increasingly using electricity to power our cars and heating systems. This is a necessary part of getting rid of carbon emissions from energy, but it poses challenges for energy system management. Unlike fossil fuel power stations, renewable generation can’t be turned up at will to meet high levels of electricity demand. As such, it is expected that demand-side flexibility will play a more important role in balancing the grid.

Demand-side flexibility means changing patterns (eg, the amount, time, or place) of electricity use. An example of this would be a household choosing to run a washing machine in the morning instead of at evening peak time, which occurs roughly 16:00-19:00 on weekdays. If everyone did this, the evening peak would be smaller, meaning that we could avoid the need to turn up costly, polluting fossil fuel power stations to meet that high evening demand.

Right now, the value of flexibility (and therefore the prevalence of flexibility products and services) is limited. In future, as renewable generation and electrification increases, rewards for being flexible (and potentially penalties for not flexing) could be much more significant. And in some countries, flexible tariffs are becoming either the default option (such as in Ontario, Canada), or even obligatory (such as in the regulated Spanish market).

There is growing evidence that households differ in their ability to provide and benefit from demand-side flexibility. For example, a household with a domestic battery can reduce its consumption to practically zero for a short period of time, while continuing to do the same activities as they would normally. Reducing demand at specific peak times is something that households are increasingly being offered financial incentives to do, particularly through National Grid ESO’s ‘Demand Flexibility Service’ (DFS) – see below. However, a household with children (meaning they are on a tight bedtime schedule) and which cooks with an electric stove will either have to make changes to the way they eat during a DFS event, or miss out on savings.

The costs of operating the energy system are passed on to all consumers through energy bills. So getting more flexibility is good for everyone, because it will help keep these costs as low as possible in the future. But if some customers stand to see significant direct savings from being flexible, while others either miss out or face higher costs – or have to compromise on comfort or convenience – there is a risk that the net-zero carbon transition could increase inequality.

At Nesta, one of our primary missions is to reduce carbon emissions from homes, and flexibility is expected to play a role in achieving this. Doing so in a way that benefits as broad a range of households as possible is not just fairer, but mitigates the risk of breaking the social contract underpinning support for net-zero transition. As such, we want to understand how more households – across a range of incomes, tenures, household make-ups, and so on – can be better enabled to provide and benefit from flexibility. In this study, we wanted to learn more about a specific group of households, and how they are already providing flexibility, by focusing on smart prepayment meter customers’ participation in the DFS.


The DFS and smart prepayment customers

While flexibility has long been a part of Great Britain’s electricity system management, the introduction of smart meters is opening the door to new opportunities to benefit from it. In 2022, National Grid ESO introduced the DFS. Offered by companies to their customers, it rewards households for reducing their electricity use below a calculated baseline at specified times (known as ‘events’) over the winter. Events are usually scheduled when periods of high expected demand coincide with low forecast generation.

The rationale is simple – it is cheaper to pay households to turn down demand at event times than it would be to generate the power that would otherwise be needed. This way system costs are reduced for everyone (lowering bills), while participating households see direct compensation for reducing their electricity use for a short period.

In this project, we partnered with the energy supplier Utilita, who specialise in serving prepayment meter customers. Prepayment customers – of which there are around 4 million in Great Britain – are significantly more likely than credit customers to be on low incomes, renting (private/social), without or with lower qualifications, aged 65+, disabled, or on the Priority Service Register (PSR) (CMA 2016, p455).

We believe prepayment customers may have different needs to credit customers in terms of benefiting from flexibility. They need to budget differently month-to-month, and often feel the impact of their increased or decreased energy usage more quickly and directly in their disposable income. Having a prepayment meter can be used as a way to avoid or manage energy debts – which for some customers can be linked to wider issues of energy affordability. Prepayment customers using smart meters can benefit from better real-time information about the energy they are using. This also means their energy supplier may be better able to pass on rewards from the DFS, as they can prove that they have shifted or reduced their demand to help the grid.

There has been increasing interest in the ability of different households to benefit from flexibility services. Assets that enable more flexibility, such as modern electric heating systems, electric vehicles, or home batteries, may be less likely to be accessible to prepayment customers given their higher probability of renting or being on a lower income than credit customers. But social factors, such as employment, the presence of children in a household, or living in a rural area can also play a role. Prior evaluation work by the Centre for Sustainable Energy (CSE) on the DFS has looked at prepayment customers’ experiences alongside that of credit customers, and found they actually report a slightly better experience on average, reporting slightly higher rewards and satisfaction.

Utilita’s DFS offering is called Power Payback, and it has operated for the last two winters (2022-2023, and 2023-2024). To read more about what it involves, click the dropdown.

Participants are invited to take part in Power Payback via email (see the dropdown in the section on signing up to Power Payback). If they sign up, they go through the following stages for each event:

  1. Notification: Customers receive an SMS up to 24 hours before an event, notifying them about the possibility of an event taking place.
  2. Opt in: Customers receive an SMS to choose to participate in the specific event, alongside an energy saving tip. This could be up to 24 hours before the event for day-ahead events, or a few hours before the event if it is a within day event.
  3. Reminder: One hour before the event starts, participants receive a reminder SMS specifying the timeframe for reducing electricity usage.
  4. Response: During the specified window, customers attempt to reduce their electricity consumption.
  5. Completion: Participants receive an SMS indicating the end of the reduction period.
  6. Results and reward: If successful, customers earn credits based on their usage reduction compared to their typical consumption. This is calculated using historic smart meter data.
  7. Credit application: Within 72 hours, earned credits are directly applied to the customer's electricity meter. Customers can transfer this credit to their gas meter if desired using the My Utilita app.
  8. Confirmation: Participants receive an SMS confirming their earnings from the event.

The service was available to Utilita prepayment customers with SMETS1 (2022/23) and SMETS1/2 (2023/24) electricity smart meters; future iterations will be agnostic to smart meter type and payment method, and feature greater app integration. Eligibility requires being a domestic customer on Utilita supply for at least 15 days, agreeing to half-hourly data collection, and having a valid mobile number.

We interviewed nine customers, recruited by Utilita, about their experience of Power Payback and their perceptions of a more flexible future for the electricity system. We wanted to delve in detail both into their DFS experience, and their perceptions of a more flexible future for energy. To provide context, we also conducted an analysis of posts on the Money Saving Expert (MSE) forum concerning DFS, identifying key themes and sentiments. For more detail, see the Methodology section at the end of this report.

We drew on this work to develop user personas, or fictionalised descriptions representing groups of users with similar characteristics. We can use these directly in future studies, informing our work to design and scale services that will help a broader range of households to provide flexibility and contribute to building an affordable low-carbon energy system. The following sections introduce our interview approach and some of our participants, our learnings on customers’ experiences of Power Payback, and perceptions of future flexibility. We then develop a range of representative personas and illustrate their different journeys attempting to provide flexibility, and how they might be improved. Finally, we suggest avenues that future work in this space could explore.

Meet the participants

Meet the participants

In this section, we present an overview of the people who participated in the study. We aimed to select participants with a range of levels of engagement in Power Payback, from those who opted in and responded to many events, to others who chose not to participate at all. The final sample included more highly-engaged participants, despite substantial efforts to recruit a more even spread. We should perhaps not be surprised by this outcome, and it may be informative in itself of a level of commitment to the service.

To learn more about the participants, we first asked introductory questions about their household setup, what their typical days and weeks looked like, their use of their smart meter and any low-carbon technologies (like solar power, heat pumps, and electric vehicles) if they had them.

Turning to flexibility, we were interested in their experiences of participation in Power Payback:

  • What factors affected their decision to (a) opt in to the service, (b) opt in to events, and (c) participate in events? How did this change over time?
  • What factors affected their perceived ability to benefit?
  • What is their overall attitude towards the offering – what did they like and dislike?
  • What features of future offerings would make it more likely that they would participate, respond, and have the best experience?
  • How do experiences/perceptions differ with household characteristics?

We then asked about their perceptions of their potential ability to participate in, and benefit from, other flexibility offerings – what might affect this, and how would they evaluate possible trade-offs between financial savings and service quality? What is their attitude towards, and awareness of, the need for flexibility in general – and who might and might not benefit?

We also conducted an analysis of MSE forum discussions about the DFS to provide additional insight on these questions. Full details of the method, including details of recruitment, interview conduct and analysis, and forum analysis are available later in this report.

Table 1 provides an initial overview of the participants, all of whom were resident in England and Wales.

The customers we spoke to generally held positive perceptions of Utilita, and most had explicitly chosen to switch to them. There was also generally high satisfaction with their smart prepayment meters, especially compared to previous non-smart versions. Perceived benefits included the ability to top up easily via the app, schedule regular top ups, and monitor electricity and credit use.

Turning to headline participation in Power Payback, across the group, savings per event ranged from £0.19 to £0.78, while total rewards ranged from £0.47 to £8.59. Maximum participation was 11 events, with a mean opt-in rate of 84%, although some people only came onto the service later, meaning that while they responded to all calls, they participated in fewer events.

Those are the overall numbers. Click the dropdowns to see short descriptions of a few of our participants and how Power Payback worked for them.

Jane (pseudonym 5) is a 45-year-old resident of a wheelchair-adapted bungalow where she has lived for six years. She lives alone with her two cats and frequently attends hospital appointments due to health issues. Her daily routine is quite irregular, with most of her activities, such as laundry and TV watching, happening at night. Her keenness to take opportunities to save money, along with a commitment to environmental sustainability, drives her participation in Power Payback, and her flexible routine makes it quite easy to respond. However, her low electricity use means her savings are generally small.

Chris (pseudonym 6) is a 35-year-old father of four, including three children with special needs. He lives in a housing association property and manages a busy household with high energy consumption due to the needs of his children and various smart devices. Chris is tech-savvy, environmentally friendly and tries to save money, but sometimes has to deal with high and inflexible demand for energy at peak hours due to the children's schedules.

Lisa (pseudonym 8) is a single mother in her early thirties living with four children in a semi-detached house, and did not opt to participate in Power Payback. Her weekdays are packed with school runs and managing the children’s needs when they get home. She didn’t have the chance to think about joining Power Payback due to her busy lifestyle having to take care of the children.

Christine (pseudonym 9), a single woman in her fifties, who lives in a house bought with family inheritance. She has been in her home for 13 years and manages her household independently despite health issues that prevent her from working. Christine spends most of her time at home, using electricity primarily for her television, lights and kitchen appliances. She has a stair lift and an outdoor platform lift, both essential for her mobility. Engaged with Power Payback, Christine takes pride in doing her bit for the planet by reducing energy consumption.

The following section provides a synthesis of experiences of Power Payback across the participants.

Signing up to Power Payback and opting in to events

Signing up to Power Payback and opting in to events

This section focuses on our participants’ motivations for signing up to Power Payback, and deciding whether or not to opt in to events. Participants were initially attracted to the service by the potential to reduce their electricity bills, but further motivations were also evident, such as the interest and potential fun of taking part, environmental benefits, and reducing strain on the grid. People tended to just opt in to events when notified by SMS. Participants are referred to by their pseudonyms.

Financial savings were motivating, but often in combination with other factors

Participants remembered first hearing about Power Payback by email. You can view the email text in the dropdown.

Earn £££s by reducing your usage with Power Payback.

Hi [Customer name],

Fancy reducing your usage and get paid? We’d love you to take part in our Power Payback service where you’ll be asked to reduce your electricity usage during a specific event, and we’ll pay you. Reduce, save, and earn – its win-win!

Take a look below to see how you can get involved.

How do I sign up?

Sign up to the service by entering your details into our form. We’ll send you an individual opt-in SMS when you can reduce your electricity usage to earn. Sign up any time!

How does Power Payback work?

  • This service will start on 30 October 2023.
  • You’ll be asked to reduce your electricity usage during a specific event. This might happen multiple times in a day. We will make sure you know when you can take part. And you can choose which opportunities you opt-in to.
  • When we know a Power Payback event is happening, we will send you an opt-in message. This could be one day prior or on the day of the event.
  • We’ll give you suggestions on ways you could reduce your energy usage.
  • If you successfully reduce your electricity usage, we’ll credit your meter. The more you reduce your usage, the more you can earn.
  • We’ll confirm the result of the event and if you’ve earned £££s.

If you’ve got any questions, please visit the Utilita Community where you’ll be able to find the answers and share your useful tips for saving energy – easy!

Utilita Trial Promotion General Terms & Conditions apply. For more information, visit our website.

What will I be asked to do?

We’ll ask you to reduce your usage in an event. We’ll give you tips on how to do this, and you’ll get SMS messages with all the information you’ll need. You’ll need to opt-in each time you get an SMS to take part. You can opt-in to multiple Power Payback sessions in the same day too.

How will I get paid?

We’ll pay you for reducing your usage while the Power Payback service is running. You’ll need to do this at specified times. You can see how we calculate your payment on the Utilita Community. We’ll send anything you earn directly to your meter.

The money you earn is paid by the National Grid – it’s a reward for reducing usage during busy times. When demand is high, they want to encourage everyone to use a bit less power.

Any questions?

To learn more about Power Payback and get answers to any questions, visit the Utilita Community.

Thank you,

Utilita Energy

The most common motivating factor for participants to sign up to Power Payback was the potential to save on their electricity bills. Interviewees were comfortable with the prospect of these savings being relatively small, particularly as they were viewed in the contexts of the current cost-of-living crisis, and potentially having a large family. There was a common theme of suggesting that ‘every little helps’, as described by Chris, a father of four:

“It was the idea that not only [...] you could save extra money and bits and pieces, but having the payback side of it, especially with a house full of kids and everything else, and being able to go, ‘I've got a way to earn something back from basically saving some extra energy’.”


Cost saving was usually mentioned alongside other motivations, including fun and interest. For example, Damon described it as, “something to do, a bit of fun. I was just intrigued by it.” Participants mentioned that the clarity of communication when they were first invited to join Power Payback was very appealing. This included an explanation as to the purpose of Power Payback as well as instructions on the structure of events. Supporting grid management or reducing fossil fuel emissions associated with peaks were very occasionally mentioned as motivating factors to opt in, such as when Gwen said, “[it] takes a strain off the grid for a little while”.

These motivations are broadly in common with those identified in previous research (see CSE, Mihalche and Hampton, 2023) on the DFS with a wider set of participants. Some motivations that featured quite prominently in work by CSE were never mentioned, such as helping reduce bills for all households and reducing reliance on gas imports.

Our interviewee Lisa, a mother of four, who did not participate in Power Payback remembered receiving the email about it, but didn’t have an opportunity to give it much thought, commenting, “I think it's just with me being busy with the children and stuff […] I don't have time to be engaging in all of that kind of email stuff”.

Generally, participants were not very clear on the central reason for the existence of the DFS. Power Payback was mainly viewed as aiming to improve customers’ knowledge about energy use and saving, and engagement with Utilita. Helping manage peaks or busy periods on the grid was rarely mentioned, despite being included in the invitation email.

People tended to opt in to events as a default

Participants were notified of specific DFS events by SMS. The opt-in SMS reads as follows: "Utilita Power Payback! Reduce your electricity usage [DAY] between [TIME_1] and [TIME_2] and we’ll pay you up to £[AMOUNT] per kWh. Normally put the washing on at this time? Try saving this job for later! Reply ‘Y’ to opt-in or ‘N’ to opt-out!" People remembered receiving the messages and most found this to be an effective method of notification. One participant noted that notification, reminder, and energy saving summary messages came from different numbers, and that consolidating these would make it easier to follow. Our forum analysis identified approval for WhatsApp-based notification, but some dissatisfaction with delayed or missed notifications in general.

Having decided to participate in Power Payback, participants tended to opt in to events almost by default; as Gwen commented, “I've just always said yes”. Again, the prospect of savings on their electricity bill by doing so was attractive. Further reasons included comparing and contrasting the savings between each event, despite the total savings for each event being relatively minimal. In multiple-person households, the decision to opt in was usually taken by one person. There was little evidence of intra-household consultation about whether to opt in, with the person who signed up taking responsibility for deciding to opt in. As Erica observed, “the financial side of things is kind of left to me because my partner's at work, [...] he just goes with what I tell him”.

There was some evidence of people considering their ability to respond before opting in. Damon, a single occupant, mentioned that he chose not to opt in to events when he was not going to be at home. This was because his approach to responding involved switching all their power off (see next section), which being out meant he would be unable to do.

Participants consistently reported that it was easy to remember when events were taking place due to email and (especially) SMS reminders sent by Utilita in advance. The reminders read: “Thank you for opting-in! Don’t forget your Power Payback event – reduce your electricity usage and earn £[AMOUNT] per kWh. The event will run between [TIME_1] and [TIME_2] today.”

Erica explained how, “I've always got my phone on me, it's in my hand or in my pocket, then that's a good reminder because the text messages are coming through [...] I'd usually just set an alarm on the phone, OK, sort of about half an hour before”. If it were the case that Power Payback customers more generally find SMS notifications to be a sufficient reminder, this suggests that inconsistency in response is less about remembering events and more about ability/willingness to respond to specific events. The way in which people responded to events is the topic of the next section.

How did people respond to Power Payback events?

How did people respond to Power Payback events?

This section focuses on what participants did to respond to Power Payback events, and what they thought about taking part in the service in general.

Responding to events – a range of actions

Interviewees undertook a wide range of types and extent of action to try and reduce their consumption. Actions taken were strongly influenced by household make-up, including the presence of children. Households with children were often on quite inflexible schedules based around school runs and bedtime. Lone occupants, on the other hand, were not constrained by the schedules and preferences of co-occupants. As Jane, who lives alone commented, “I know for some people maybe [events] might be across tea time, but I tend to eat a bit later”.

The most common actions across all household types were turning off TVs, computers and making sure that plug sockets were turned off. Often this included watching programmes or playing games on phones or tablets instead. Some participants also described how they moved the time of their usual evening activities, such as cooking and washing, in an attempt to shift their consumption, although shifting cooking was harder when younger children were present. It was common in our sample for someone in the household (usually the interviewee) to often be at home during the day, meaning doing activities like laundry at non-peak times was possible.

“I would actually go around and make sure the plug sockets are turned off […] And I would purposely make sure that I'd done laundry prior […] watch something on my phone instead.” (Erica)


Despite only being able to reduce their electricity use in a small proportion of events, Erica’s household was among the highest savers overall (at £7.48). This was because it typically has higher electricity consumption, meaning that savings (when they did come) could be larger.

Some participants described how they had adopted new methods of control to try and make turning off their devices easier. This included the use of timers for thermostats as well as remote controls that enabled the turning off of lights without having to go to each room individually. For example, Kaye found that purchasing a voice-activated timer for the heating of their lizard tanks allowed them to better regulate their energy use, as “the heat is off a couple of times a day for an hour or so, and the tanks still hold the heat”.

The most extreme action that a participant took was turning their fuse box off so that they could completely remove all consumption from their property. To mitigate this loss of power, Damon would download films and TV programmes to watch on his laptop during events.

“I [...] just flip both power breakers off. … I've got a little external hard drive with a load of films and TV on. I'll just plug that into my laptop and sit back and watch something on that because obviously my router goes off as well when I switch all the power off.”


Because he lived alone, he could take this action without the risk of affecting other occupants. However, it also meant that his electricity use was generally low, meaning that his overall savings per event were the lowest of all the participants (at an average of £0.19 per event).

No-one mentioned using low-carbon technologies such as solar panels, heat pumps, domestic batteries, and electric vehicles differently to respond to Power Payback, even where (rarely) some of these were present. However, one participant with solar panels had previously changed to run their electric water heater over the middle of the day, so as to benefit from lower-cost power at this time.

In our forum analysis, discussion of responses using low-carbon technologies was infrequent but still more common. For example, people discussed how they hoped to use home batteries to export electricity and earn greater rewards.

Power Payback was popular – despite often small savings

Amongst our participants, there was generally a positive attitude towards Power Payback – although it is possible that less satisfied customers would have been less inclined to participate in this research. Interviewees mentioned that they found the events “fun” and “easy” to take part in. They appreciated the opportunity to save on their electricity bill whilst taking part in an activity that they considered as benefiting the environment. Relatively low rewards from each event were noted and a participant mentioned that it would have been nice to have saved a little more. Despite this remark, the magnitude of savings did not appear to cause any dissatisfaction or reluctance to participate in future events – again, the prevailing view was reflected by Jane, who observed that, “I know it's not a huge amount, but any little amount still helps really, doesn't it?”

Our MSE forum analysis suggests that dissatisfaction with the level of the incentive was common amongst forum posters. Almost half the times it was mentioned, it was in a negative context, compared with just over 10% being positive.

Households with children tended to appreciate the opportunity Power Payback provided to gamify energy. This took the form of participants getting their children to actively go around the home to try and find appliances or plug sockets that could be turned off. Sometimes parents even used the incentive payment to encourage their children, as in this example from Kaye:

“And what I did is with the Power Payback, whatever the money that I got back, although it wasn't a lot, I rounded it up to the next pound and he got that money. And he thought it was absolutely brilliant.”


There were also some limited reports of conflict and disagreement with children. As Gwen commented, “My son wasn’t impressed when I told him he couldn't have his computer and his Xbox on, but he managed”. The fact that events tended to happen at a similar time of day (early evening) was a frustration for some participants, especially when children were present. There was a sense that this is when the most important things are happening, not just for them but for many households. For example, Erica explained that “the most recent ones I found was all kind of at the same time period, which is really peak time. I think not just for us as a family, but for a lot of families”. Participants didn’t generally draw an explicit causal link between this kind of observation and the underlying reason for the timing of Power Payback events (managing peaks).

For households without children present, beyond financial and energy saving benefits, participants appreciated the opportunity to disconnect and do something different. As Jane observed, “it was actually quite nice in a way to turn everything off for a bit and just sit and chill out”.

There were mixed views on the quality of feedback received after events. Following an event, Utilita would send messages to customers with different wording depending on whether they saved energy or not. If they saved, the SMS read as follows: “Congrats! You’ve earned £[AMOUNT] by Power Payback! We’ve credited your electricity meter. Check out Utilita Community to see how we calculate your payment [URL].” If they didn’t save, the message read: “Thanks for taking part in Power Payback – unfortunately you didn’t manage to reduce your electricity usage enough to earn energy credit. Head to [URL] for some handy tips to reduce your energy for next time.” A confirmation SMS was also sent when credit was transferred to the meter. Some participants found the savings confirmation messages clear, while others highlighted some possible sources of confusion, relating to both information source and timing. For example, delays between the event and receiving feedback meant that participants weren’t always sure which event the feedback related to.

“There might be a Power Payback today, there might be a Power Payback tomorrow. And it used to take a couple of days before you got a text to say if you'd saved any energy and how much money had been credited to me … So I didn't know what date related to and when it was.” (Nick)


Our MSE forum analysis revealed that, behind only the size of the reward, most negative comments were directed towards apps/notifications, and smart meter data. The latter appears to reflect issues around customers not being able to participate due to smart meter data access problems – an issue that was not reported by any of our participants.

Having considered participants’ reflections on taking part in Power Payback, the next section turns to explore how flexibility services – both DFS and more broadly – might be evolved and taken up in the future.

Future flexibility

Future flexibility

Power Payback is the first exposure that many of our interviewees had to a modern flexibility offerings. Based on their experience, we were keen to learn how they thought the service might be designed to work better for them. We also explored their perceptions of a future where flexibility plays a more prominent role in the way people interact with electricity.

Customers’ suggestions for Power Payback

Participants described wanting increased warning of events alongside a calendar style notification with possible events for the month. This was to help participants plan ahead to maximise their involvement. This was especially important for certain families, such as those including children with special needs, which made pre-planning more of a necessity. For example, Kaye, whose son has special needs, told us, “You'd need to be able to let them know in advance and plan things so you can then get them ready for it”. In practice, achieving more warning would have been hard to achieve because of the limited notice period that DFS operators receive that events will be needed – and indeed, this period may be even shorter as the service evolves (potentially transitioning from day-ahead to within-day procurement.

Participants also expressed a desire for greater variation in the times and days of the week that events took place. This came from the observation that times were not always convenient and that they had differing schedules on weekdays vs weekends. There was also some appetite for events to be run more often, with Gwen reflecting that, “I think it would make people more aware of their usage”. Both of these suggestions are unlikely to be consistent with the aims of infrequent, event-based flexibility schemes like the DFS. However, they could potentially be features of alternative flexibility products like time of use tariffs.

Participants noted that real-time feedback during events would be desirable so that they could keep track of their consumption. It is worth noting that one of the participants that found this aspect desirable did remark that they actually had an in-home display, but had not been monitoring it during events. Another interviewee, Damon, remarked that they would then like to be able to compare their performance between events to see whether they had been able to reduce their consumption even more:

“It would be nice to have a little side chart [showing] how much you saved on average from your previous six months’ usage, you know, ‘you've reduced your usage by 10% or five kilowatts over that hour’.”


There was a desire from those with children for Utilita to provide some additional resources to aid participation of family members. This could come in the form of physical resources such as board games, potential competitions via an app, increased information for children to show which appliances should be turned off and even targeted help for children with special needs. As Kaye described it, “Utilita could [...] send out a little package for children to engage them a little bit more”.

Views on a flexible future

National Grid ESO recently confirmed that the DFS will continue to be developed for use in managing periods of high demand on a year-round basis. It’s likely that services like Power Payback – that incentivise occasional responses from customers at short notice – will remain a part of the flexibility landscape. But these services will increasingly be joined by a wider suite of offerings, including time of use tariffs (with fixed or variable rates). We talked with participants to get their thoughts on a more flexible future – both in general, and regarding their own perceived ability to benefit.

There was some familiarity with legacy time of use tariffs, such as Economy 7, which charge a cheaper off-peak rate overnight, and which a number of participants had experienced directly. Modern flexibility tariffs were seldom mentioned (with one mention of British Gas weekend savings tariffs). In our forum analysis there was more evidence of familiarity with flexibility products such as the Agile tariff from Octopus, including discussion of how these interact with the DFS.

In general, participants expressed mixed views on fixed flexibility products like time of use tariffs, and tended to be more negative than positive. Barriers cited included having fixed schedules with younger children, preference for a flat tariff for reasons of familiarity, and concern about operation of appliances overnight. Encapsulating this demand for stability, Erica shared that, “I would rather have to spend that little bit more to keep the structure in family life than lose that entire routine and then it creates chaos elsewhere.” However, she also reflected that if her children were older this could change, and a participant with older children thought that they would more easily be able to change their schedule.

It is worth highlighting that people may have quite different responses to products or services framed in general, rather than specific terms. This is associated with construal level, or the extent to which people are thinking about something in abstract or concrete terms. It is possible that providing specific details on prices and potential savings for a time of use tariff could have affected people’s perceptions of their willingness and ability to benefit from it.

People’s awareness of the reasons and need for flexibility was generally low. While relieving strain on the grid around peak times received occasional mention, people more commonly understood Power Payback to be aimed at helping save energy in general, improving knowledge about energy saving, and supporting engagement with Utilita:

“I think it's trying to make people aware of what electric they're using, whether they're wasting it.” (Gwen)


Certain groups in the population were seen as being more likely to be able to benefit from flexibility, including singles, couples, and older people who may be more likely to be at home during the day. However, concerns were not generally expressed about the potential fairness implications of this – indeed, it was seen as reasonable that some households should pay more because of when they were using electricity. As Erica, who has children, commented:

“It's not 100% fair, but when you look at it from that point of view [...] it's understandable because we would be using more. So why wouldn't we pay more because we're using [electricity] in that period of time, whereas a couple or a person on their own wouldn't be. So you wouldn't expect them to pay more.”

This should be considered in the context of the earlier discussion around dissatisfaction with events coinciding with the evening peak, especially where children are present. It’s possible that as penetration of flexibility services increases, this inability of some households to respond could be felt more keenly.

As part of Nesta’s ongoing work on home decarbonisation, we’re keen to support the development of services that enable a broader range of households to benefit from providing flexibility. The next section describes the development of a number of user personas, based on this research, that we and others can use and develop when thinking about inclusive service design.

Journeys through Power Payback

Journeys through Power Payback

To help inform future work in the area of inclusive flexibility, we developed three provisional user personas based on the interview data we collected. Personas are fictionalised descriptions representing groups of users with similar characteristics. They are helpful in the process of designing products, services, and solutions to better address user needs – which can then be developed with the involvement of real users. The personas presented here reflect a range of attributes of our participants and their experience of engaging with Power Payback.

It is important to recognise that a persona approach can never fully capture the diversity of experiences likely to be encountered by users. However, it can help prompt creative thinking about solutions that can address a broader variety of needs than may otherwise be the case. We expect to develop these and additional personas as we learn more about people’s experiences and expectations for flexibility in the course of our work.

To develop the personas, we first identified important dimensions of difference or commonality across our participants:

  • Structured schedule: This refers to how rigidly household schedules are structured by things like work, school runs, or children’s bedtimes.
  • Energy curiosity: This describes a level of keenness to learn about, and experiment with, energy use.
  • Self care: This describes the extent to which schedules and activities are structured by self-care requirements for issues relevant to health, such as medical equipment and appointments.
  • Other care: This captures the level of general caring responsibilities for others, such as children or partners.

These factors were commonly associated with, and used by participants to explain, aspects of their experience of the Power Payback service. We sketched out backgrounds, enablers, and barriers to participation, and created generalised descriptions of these attributes informed by the interview data. We illustrated the general descriptions with examples drawn from the participants in this research, acknowledging that in reality many of our interviewees will lack some characteristics of a particular persona, or show characteristics of more than one persona.

Persona 1: Energy Educator

Gwen

The Energy Educator is a parent in their 30s or 40s, living in rented accommodation in urban or suburban areas, with a younger child or children. Money is often tight but, with careful management, they are getting by. Cost-saving is the priority for them, but when it comes to saving energy, they are also keen to take opportunities to help their children learn. They may use smart meters and other energy-saving technologies to monitor and manage their household's energy consumption, sometimes involving their children in these activities to instil good habits early on – but also experiencing some conflict. Despite their busy schedules, they try to incorporate energy-saving practices into their daily routines where possible.

Goals:

  • Reduce household energy bills to better manage household finances.
  • Educate their children about the importance of energy saving.
  • Feel they are reducing the negative environmental impact through flexibility approaches.

Dimensions:

  • Structured schedule: Energy Educators tend to have more highly-structured routines due to parenting responsibilities.
  • Energy curious: Energy Educators are keen to take opportunities to support their children to learn more about energy (and how to save it).
  • Self-care: Energy Educators may deprioritise self-care in favour of caring for others.
  • Other care: Energy Educators have significant caring responsibilities (for their children).
Read the text-based description of this image

Image Description

Gwen

Bio

Gwen is a single mother in her 40s, who resides in her council house with her two children. She has lived there for 23 years. Balancing her job and household responsibilities, she is committed to energy conservation as both a cost-saving measure and an educational tool for her children, particularly her older child, who has a keen interest in engineering. Her motivation is driven by the need to reduce costs and instil good energy habits in her children.

Barriers

Gwen encounters minor conflicts with her children when trying to enforce energy-saving practices, such as turning off the Xbox or computers during Power Payback events. While her older child, who is interested in engineering, is more receptive, her younger child is less engaged. This makes it harder for Gwen to consistently involve both children in energy-saving efforts​.

Quote

"I made the kids turn their TVs off on standby and that's wasting electricity. So it makes them more aware of what they're doing. I think it's nice to do it to be fair."

Erica

Bio

Erica, a mother of four, balances the demands of a bustling household while encouraging energy saving in her children. With a partner who leaves the financial and administrative tasks to her, Erica takes the lead in participating in Power Payback events. She educates her children about the importance of energy conservation by incorporating practical activities, such as turning off unnecessary appliances and scheduling high-energy tasks during off-peak hours.

Barriers

Power Payback event timings often coincide with peak household activity times, making it difficult for Erica to participate effectively. Erica finds it challenging to balance the different energy needs and preferences of her children, especially when they have conflicting demands for using electronic devices and entertainment.

Quote

“With my four children, it's literally non-stop, but I try to teach them to turn off lights and devices when they’re not in use.”​

Persona 2: Flexible Disconnector

Screenshot 2024-10-04 at 10.54.43

Flexible Disconnectors often live alone or with one other person in urban or suburban areas. They enjoy the opportunity Power Payback events provide to disconnect from their routine, take a break, and do something different, such as watching a movie from the laptop or going for a walk. While cost-saving is the main driving force, the Flexible Disconnectors are highly attracted to the invitation to relax and switch off from their usual energy use. Their flexible schedules and minimal household coordination allow them to adapt to these events.

Goals:

  • Reduce energy bills even if the saving is small.
  • Enjoy the break from routine offered by Power Payback events and engage in simple and relaxing activities.
  • Contribute (sometimes) to environmental efforts.

Dimensions:

  • Structured schedule: Flexible Disconnectors’ schedules are less structured by those of other occupants.
  • Energy curious: Flexible Disconnectors may be interested in energy, but it is not a driving factor for their involvement in Power Payback.
  • Self care: Some Flexible Disconnectors might have significant self-care needs, such as chronic health conditions or disabilities.
  • Other care: Flexible Disconnectors may have less caring responsibilities for others if they live alone.
Read the text-based description of this image

Image Description

Damon

Bio

Damon lives on his own and is currently looking for work, following a period of ill health and, before that, homelessness. He is interested in energy and does his best to use as little as possible, in part for cost reasons. He enjoys the time to relax when he switches all the power off at the fusebox during the Power Payback events.

Barriers

Damon already has a very low-energy usage, which limits his ability to further reduce consumption during Power Payback events. Inconsistent and delayed notifications about Power Payback events make it difficult for Damon to plan and participate effectively.

Quote

“Me and my partner like to exercise. We went out for a walk during the hours.”

Nick

Bio

Nick, a 33-year-old social care worker, lives in an urban flat with his partner. Both lead busy lives with varying schedules, which allows them flexibility in managing their energy usage. Nick appreciates the Power Payback events as an opportunity to disconnect from daily routines, using the time to engage in simple, relaxing activities such as going for a walk.

Barriers

Nick sometimes has to deal with the lack of interest of his partner and remind him of the importance of saving energy during event times. The saving notification of the events can sometimes be delayed and unclear, making it hard for Nick to track his progress and stay motivated.

Quote

“So there's something about the feeling of disconnecting a little bit from being plugged into things where you don't feel as if you need to do something.”​

Persona 3: Energy Explorer

Energy Explorers are typically in their 30s to 50s, living in households that include multiple members. They approach Power Payback as an engaging challenge, experimenting through events to see what approach would have the most impact. These individuals have a high level of willingness to engage and experiment due to curiosity with Power Payback, which may or may not be accompanied by a higher level of tech literacy. Their primary goals are to reduce energy bills and explore innovative ways to optimise their household systems. Energy Explorers enjoy the process of discovering what works best, turning energy-saving efforts into a creative endeavour.

Goals:

  • Reduce energy bills through experimentation.
  • Have fun experimenting with energy-saving techniques.
  • Optimise household systems to reduce energy consumption.

Dimensions:

  • Structured schedule: Energy Explorers’ schedules might be flexible or inflexible depending on the level of their caring responsibilities.
  • Energy curious: Energy Explorers are defined by their desire to learn more about their energy use (and how to reduce it), which drives them to experiment with different energy-saving techniques.
  • Self care: Energy Explorers have varying levels of self-care requirements.
  • Other care: Energy Explorers also have varying levels of caring responsibilities for others.
Read the text-based description of this image

Image Description

Chris

Bio

Chris, a father of four, lives in a suburban home with his children, three of whom have special needs. Chris enjoys experimenting with smart technology to find innovative ways to reduce his energy consumption. He has replaced most of his traditional light bulbs with smart bulbs and installed smart plugs to control energy usage remotely, allowing him to monitor and adjust his household’s energy consumption even when he's not at home. For Chris, the process of discovering what works best is as rewarding as the cost savings.

Barriers

Living in a housing association property, Chris is unable to make significant changes, such as installing solar panels without approval. This restricts his ability to further optimise his household’s energy efficiency. Chris experiences confusion due to receiving notifications about Power Payback events from multiple different phone numbers. This inconsistency makes it difficult for him to track event details and participation effectively.

Quotes

“We went around [to turn off] different devices each time to see how things were going... We tried everything else up to that point.”

“90% of my house is on smart stuff. You'll be able to see more of what you're using and what is using more power. So it's like smart bulbs and everything else.”

Kaye

Bio

Kaye is a resourceful mother in her 30s, living in a two-bedroom home with her 13-year-old son with a disability. Kaye approaches energy-saving initiatives with curiosity and enthusiasm. While not highly tech-savvy, Kaye has experimented with various methods, such as using smart plugs to manage the energy use of her lizards' heating systems and integrating Alexa-controlled devices to optimise her household’s energy efficiency. She enjoys involving her son in these activities, turning energy conservation into a family learning experience.

Barriers

Kaye's son has medical needs that require constant use of electrical equipment. This makes it difficult to reduce energy consumption significantly without compromising his care. Kaye faces some technical challenges with her smart meter, such as inconsistent communication with the app, making it hard to monitor and manage energy usage effectively.

Quotes

“I've got an Alexa for the plug for the thermostats and heaters. By doing that, I can actually turn the lizard tank off a couple of times a day for an hour or so, and the tanks still hold the heat. So I've been able to save electricity with that because I know that's going to eat electricity.”

“We've recently switched over to Alexa light bulbs which are a lot easier to turn off and on. So if I go upstairs and I've realised I've left the light on I can just tell Alexa to turn it off."

Read the text-based description of this image

Image Description

We consolidated the journey of a Power Payback participant detailing the desired actions and outcomes at each stage, and opportunities for development of similar flexibility services in future. Although actions are similar across personas, we highlight differences in opportunities where relevant.

Customer actions and outcomes

Power Payback awareness and sign up

  • Become aware of the Power Payback service, and sign up to participate.

Opting in & participation in events

  • Become aware of and opt-in to events, and reduce energy usage during the event period.

Continued engagement with events

  • Review feedback from previous events to understand saving patterns and adjust approach.
  • Stay motivated and enabled to continue responding.
  • Increase energy/flexibility literacy and lock in energy-saving behaviours.

Opportunities

Power Payback awareness and sign up

  • Scope ways to build wider awareness of the need for flexibility through public, civil, corporate, and other routes.
  • More prominently highlight the opportunity to learn about energy and try something new.
  • Use sign-up as an opportunity to request more information from people about how they can be better supported to save. For example, would they like to opt to receive details of activities for children?

Opting in and participation in events

  • Consistent and timely notifications about events through preferred communication channels.
  • Explore effectiveness of forms of guidance on reducing consumption during events, including on savings potential of different actions.
  • For Energy Educators:
    • Develop activities, games, and learning resources that can be used with children.
    • Requesting automated notifications that align with their schedules could help them balance energy savings with family needs.
  • For Flexible Disconnectors:
    • Encouragement and tips for things to do (eg, taking a walk, book recommendations) when disconnecting.
  • For Energy Explorers:
    • Encouragement and tips on trying out different energy-saving techniques, eg, using smart plugs.

Continued engagement with events

  • Faster feedback about event savings.
  • Incentives for reliable participation.
  • For Energy Educators:
    • Having the opportunity to continuously engage the children in energy saving by offering gamification and activity guides.
    • Opportunities to share tips and achievements with peers.
    • Varying activities (eg, low-energy meals suggestions).
  • For Flexible Disconnectors:
    • Sharing opportunities: book discussions, walk photos.
  • For Energy Explorers:
    • Providing more detailed, personalised feedback, allowing people to note what actions they took.
    • Enhanced performance tracking, social comparison.

Conclusion and next steps

Conclusion and next steps

Great Britain is in the early stages of a flexibility transition. This report has described the ways that smart prepayment customers have responded to, and derived benefits from, the early iterations of the DFS, even while financial rewards were low in the context of annual energy bills.

Our findings suggest a variety of motivations for participation that go beyond bill savings – especially around learning more about energy saving (for self and others), getting enjoyment from participating in an interesting initiative, and treating the events as an opportunity to disconnect and do something different. It also shows that even small savings are welcomed, as ‘every little helps’ when things are tight. We didn’t hear concerns around the fairness of rewards – which was a more prominent theme both in our forum analysis and in previous DFS evaluation.

While our small sample of participants cannot fully represent prepayment customers, it isn’t a surprise that we saw little presence of low-carbon technologies like solar panels, domestic batteries, heat pumps, and electric vehicles. Where our participants were able to be flexible, it was mainly through manual changes in the timings of activities. Often this was against a background of already low electricity use. The irregular and infrequent nature of DFS events meant that these changes were generally acceptable, although the idea of making them more constantly was less attractive.

Participants showed variable levels of understanding of the reasons why DFS events happen, and we add our call to others to take this opportunity to raise awareness of the underlying need for flexibility as part of decarbonising the energy system. We believe there is scope to do this in ways that speak more meaningfully to the personal motivations of DFS participants.

Building awareness of flexibility

At this stage in the flexibility transition, building familiarity with flexibility should be a fundamental goal. As heating and mobility are increasingly electrified across income levels and tenures, wider societal recognition of the need for (and benefits of) flexible operation will become more critical. Policymakers and system planners should be thinking carefully now about how this can be effectively achieved. The DFS potentially provides a valuable vehicle because it is high-profile and eye-catching, but with relatively low stakes.

Given the relatively low value of flexibility and low capacity of many households to significantly reduce their electricity use for events, suppliers need to be mindful of not pushing households into changes in activities that outweigh the rewards. A balance needs to be struck that capitalises on the opportunity to provide moments for learning, fun, or relaxation, without placing a sense of financial obligation onto households to make disruptive changes in order to realise small savings. This could include approaches such as:

  • learning packs and games for kids
  • low energy, low stress meal suggestions (‘picnic nights’)
  • chillout hours (eg, with book, music, or relaxation suggestions)
  • energy tune-up events (eg, with suggestions for ways of experimenting to track and maximise savings).

Importantly, a clear thread should always be drawn between the engagement and a clear statement of why it is being done now (ie, to take pressure off the grid). Taking such an approach probably means rethinking the metrics that are used when measuring the effectiveness of schemes like DFS. While the magnitude of demand response will remain important from the perspective of system operators, policymakers and system planners should take a more strategic interest in knowledge/awareness and satisfaction.

Recognising reliability

It is clear that some prepayment customers are indeed able to deliver larger reductions that can represent both more significant financial savings, and add up to a meaningful level of demand response. The key challenge here becomes managing the predictability and reliability of the response – especially given proposals to reduce payments to DFS operators for under- or over-delivery of response.

A variety of mechanisms could be explored to increase reliability, including recognising consistency of response as well as magnitude, supporting automation of response, gamification approaches, seeking commitments or pledges to respond, along with generic approaches such as providing tips on effective energy saving. However, it is important to be mindful of the reasons why households may only be able to respond sporadically, such as interaction with children’s schedules, and take an enabling rather than a pressuring approach (eg, see low-energy meals suggestion above).

These approaches are summarised in Figure 1.

Figure 1: Heuristic for how to engage with customers depending on the magnitude and reliability of their response to DFS events.

Read the text-based description of this image

The personas we have begun to develop can be helpful in thinking about how solutions for these quadrants might be developed. For example, Energy Educators with their higher electricity use but inflexible schedules may tend to be positioned in the top left. Flexible Disconnectors, with lower electricity use but more discretion around when they use electricity, are likely in the lower right. Energy Explorers may already be providing reliable flexibility. Wherever a household is positioned, it is clear that building their underlying capacity to be flexible is likely to make it easier both to provide more flexibility, and to do it more reliably.

Building flexibility capital

Where the capacity to provide flexibility becomes valued, it can be helpful to view it as a form of capital – flexibility capital. Households that can provide more flexibility, for example by smart charging an electric vehicle or cooking at different times, have more flexibility capital. This discussion has mostly focused on how households’ existing holdings of flexibility capital are unlocked and turned into flexibility (and rewards) by services like Power Payback.

We need to recognise that the value of flexibility is very likely to increase, and with it the potential for the gap to grow between those households that are able to provide larger responses and those who can’t. So alongside building awareness, now is a time to focus on building the flexibility capital of a broader range of households. While factors such as awareness of how to provide flexibility are part of this, households with larger loads, or onsite generation or storage, are best placed to make larger and more reliable savings.

If we are to rapidly maximise the amount of flexibility we can draw on in a decarbonised electricity system, we need to explore ways of getting these technologies into the homes or communities of a broader range of households – including those of prepayment customers. While subsidy schemes such as the Social Housing Decarbonisation Fund help in this regard, a host of further opportunities and challenges present themselves. These include innovative business and funding models, identifying barriers in regulation and procurement, and tackling issues with engagement and installed performance of technologies.

We expect to conduct future work in these areas with a view to improving inclusion in the low-carbon transition – as an end itself, but perhaps more importantly as a means to success.

Methodology and acknowledgements

Methodology

Interviews

This section provides details on the method used for this project following the COREQ guidelines for reporting of qualitative research. We carried out nine semi-structured interviews with Utilita customers and conducted a simplified thematic analysis of their answers based on the interview transcripts.

Research team

Interviews were led by one of three Nesta team members with experience of conducting research interviews, usually joined by another Nesta staff member to assist in note taking, and always by a Utilita staff member. Participants were not known personally to the interviewers, although they may have had a brief conversation with the Utilita staff member during recruitment (see below).

Study design

The sampling frame was Utilita customers with smart prepayment meters who were invited to participate in Power Payback. Utilita classified Power Payback participants into high, medium, and low engagement based on the proportion of events they opted in to. Further groups were identified for customers where Utilita had a record of the presence of a low-carbon technology such as solar panels or a heat pump, and for customers who did not opt to take part in Power Payback at all. Customers in all these groups were contacted by telephone to invite them to participate. We aimed to recruit 8-12 participants, spread evenly across levels of engagement. If they agreed, a time slot was booked, and they were asked to complete an online consent form. A £50 incentive voucher was offered as a thank you for taking part in the interview.

At the halfway point of the study, 18 participants had consented to be interviewed and arranged a slot, but only four had joined an interview. To improve the likelihood of ultimately recruiting enough participants, Utilita then contacted larger groups of customers by email asking them to express interest in participating. These customers were called back to arrange an interview. This resulted in a further five interviews being conducted, leading to a total of nine (see table 1). Ongoing analysis (see details below) suggested that data saturation had been reached.

Interviews were conducted online on Microsoft Teams and lasted up to 45 minutes. Prior to each interview, Utilita prepared a briefing sheet with some background information on the participant and their participation in Power Payback, as summarised in table 1. Nesta and Utilita team members joined a brief meeting in advance of each interview to become familiarised with this data. Interviews followed a topic guide, but were semi-structured and so deviated from the guide to explore points raised by participants, where appropriate. Interviews were recorded and automatically transcribed by Microsoft Teams, and notes were taken during the course of interviews to record immediate reflections.

Qualitative data analysis

Thematic analysis of the interviews was conducted using the qualitative software Quirkos. Following a general grounded theory approach to coding, transcripts were imported into the software, and an initial two interviews were blind-coded by three members of the Nesta team. There was good alignment between coders and, following discussion to maximise consistency in approach, the remaining transcripts were divided between the team. Themes emerged from the codes that were developed both deductively from the research questions and inductively from the raw data. We summarised these themes in the report, and used them to help identify illustrative quotations.

Forum topic and sentiment analysis

We also conducted a forum sentiment analysis to provide additional insight into experiences of, and attitudes towards, DFS offerings from a broader range of perspectives – such as credit customers, and households which are more likely to have low-carbon technologies such as domestic batteries or electric vehicles. This analysis was conducted using data extracted from MSE forum posts. Sampling bias resulting from factors such as who chooses to post on MSE forums, and why, means that forum data does not provide a representative view of DFS attitudes and experiences. Observations such as whether certain topics are raised at all can provide helpful context.

The earliest available post is from 2003 (although in practice the earliest post drawn on is from 2022 as that is when the DFS began), and the most recent data is from 3 June 2024. We searched for posts mentioning the following terms: ‘demand flexibility service’, ‘DFS scheme’, ‘Power Payback’, ‘Saving Sessions’. We included Saving Sessions (the DFS offered by Octopus) because it made up the largest share of demand shift in the winter of 2022/23. These terms appeared in 24 posts, which together with their total of 2,166 replies provide the corpus for this analysis. To identify themes of conversation, posts were broken into individual sentences, small sentences removed, and topic modelling (BERTopic) used to cluster sentences by topic. A sentiment analysis model was used to classify sentences by sentiment (positive, negative, neutral). By aggregating the data by theme and sentiment we were then able to draw on it in the relevant sections of this report. The analysis code is available in this GitHub repository.

Acknowledgements

We are extremely grateful to Utilita for partnering with us to explore their customers' experiences of taking part in Power Payback. In particular, we would like to thank Rebecca Clark, Dimitrios Stefanoglou, and Archie Lasseter for all their work to enable the project. Many thanks also go to the interview participants for taking the time to talk with us.

Nesta would also like to thank Camille Stengel, Head of Qualitative Research and Quality Assurance, for her assistance on this report.

Michael Fell’s work on this project was partially funded by the UKRI Energy Demand Research Centre (EP/Y010078/1).

Authors

Michael Fell

Michael Fell

Michael Fell

Senior Researcher, sustainable future mission

Mike is a senior researcher in the sustainable future mission at Nesta, on secondment from his role as a senior research fellow at University College London (UCL).

View profile
Yini Zheng

Yini Zheng

Yini Zheng

Designer, Design & Technology

Yini is a designer for the Design & Technology practice and will be working on various projects combining behavioural insights with her service design expertise.

View profile
Andy Regan

Andy Regan

Andy Regan

Senior Mission Manager, sustainable future mission

Andy works within the Nesta Cymru team as mission manager for a sustainable future.

View profile
Max Woollard

Max Woollard

Max Woollard

Analyst, sustainable future mission

Max joins Nesta as an analyst in the sustainable future mission.

View profile
Sofia Pinto

Sofia Pinto

Sofia Pinto

Data Scientist, Data Analytics Practice

Sofia is a data scientist working in the Data Analytics practice.

View profile