Do you use census data? We'd like your feedback.

Island Communities Impact Assessment

An assessment of the census' impact on island communities.

Title of Programme

Scotland’s Census 2022.

The need for an Island Communities Impact Assessment

Under the provisions of the Islands (Scotland) Act 2018 an island communities impact assessment is required in respect of a policy, strategy or service which is likely to have an effect on an island community which is significantly different from its effect on other communities, including other island communities.

It is important to note that the impacts identified as part of this assessment are generally not exclusive to island communities, and accordingly do not fall directly within the scope and spirit of the Islands (Scotland) Act requirement for impact assessment. However, as Scotland’s Census impacts all parts of Scotland including its numerous inhabited islands in many different ways there is merit in having a particular focus on how the programme affects and considers island communities, for example around the contexts of digital exclusion and Gaelic language which have similar relevance in rural, remote and other mainland communities.

Background

What is the census?

The census is the official count of every person and household in Scotland. It is usually held every 10 years and provides the most complete statistical picture of the nation available. It also provides information that central and local governments need, in order to develop policies and to plan, fund and run public services.

Scotland's Census is taken by the National Records of Scotland on behalf of the Registrar General for Scotland. The National Records of Scotland (NRS) is a non-ministerial department of the Scottish Administration, established on 1 April 2011, following the merger of the General Register Office for Scotland (GROS) and the National Archives of Scotland (NAS).

The main purpose of NRS is to collect, preserve and produce information about Scotland's people and history and make it available to inform current and future generations. It holds records of the census of the population of Scotland from 1841 and every 10 years after that. The one exception to date was the wartime year of 1941 when no census was taken. Census records are closed for 100 years under the Freedom of Information (Scotland) Act 2002.

Scotland’s Census moved to 2022

On 17 July 2020 the Scottish Government announced the decision to move Scotland’s Census to 2022 following the impact of the COVID-19 pandemic.

The census collection is a huge logistical operation involving the recruitment and deployment of thousands of staff, including a large field force team who engage with the public on their doorstep. The 12 months leading up to a census are vital in planning and testing the effectiveness and safety and security of census systems and collection processes to ensure these are ready. COVID-19 restrictions during 2020 prevented these key activities from progressing. These impacts occurred in a number of areas, from progressing recruitment to being able to undertake comprehensive testing, from contacting care homes and hospitals to establish their requirements for questionnaires to engaging with third sector and community groups to encourage participation from everyone in Scotland.

The priority and responsibility of NRS is to put in place a census that enables everyone across Scotland to participate, so that information collected can be used to produce high quality outputs and deliver the benefits required by the people of Scotland. We had been monitoring the impacts of COVID-19 on the delivery of the 2021 census and explored a number of options to preserve this census date. The conclusion by NRS was that the only option in which there was confidence around securing the high response rate required was to move the census to 2022. Following the recommendation, Scottish Ministers decided to move Scotland’s Census to March 2022 to ensure that a full and successful census is undertaken.

The census in March 2022 will follow the same model and question set as planned for March 2021. We will work closely with our stakeholders and partners to ensure that appropriate data is available to support work that was expecting to make use of Census 2021 data. We will also continue to work closely with our colleagues in the Office for National Statistics (ONS) and Northern Ireland Statistics and Research Agency (NISRA) to ensure the needs of data users in Scotland and across the rest of the UK will be met.

Census legislation

The Census Act 1920 ("the 1920 Act") provides for a census to be taken not less than five years after the previous census. The 1920 Act applies to England, Wales and Scotland. In Scotland it is the duty of the Registrar General to undertake the census, in accordance with the 1920 Act and any Order in Council or regulations made in terms of the 1920 Act, under the direction of Scottish Ministers.

Section 1 of the 1920 Act provides the enabling power which underpins the taking of the census. It allows the making of an Order in Council (“the Census Order”) which directs that the census be taken; the date on which it is to be taken; the persons by, and in respect of whom, returns are to be made; and the particulars which are to be stated in the returns. The questionnaire (or questionnaires) used in the census are prescribed in regulations (“the Census Regulations”) under section 3 of the 1920 Act. This is where the census questions, as they will be seen by individuals completing the questionnaires, are legally set out. The questions must, of course, solicit the particulars set out in the Census Order.

All of the legislation required for a census in 2022 is now in force.

Non-compliance

There is a legal requirement to complete the census. Those householders who do not make a census return may be prosecuted and could receive a criminal record and / or fine. It is also a criminal offence for a person to refuse to answer a census question, or give a false answer. The only exceptions to this are the voluntary questions on religion, sexual orientation and on trans status or history, as enabled by the Census (Amendment) (Scotland) Act 2000 and Census (Amendment) (Scotland) Act 2019 respectively. Together, both Acts specifically exclude penalising non-response to these questions.

Why have a census?

For over 200 years, Scotland has relied on the census to underpin local and national decision making. Around 200 countries worldwide now undertake a regular census under the UN census programme. The census is the only survey to ask everyone in Scotland the same questions at the same time. It is unique in the provision of comprehensive population statistics. It is used by central and local governments, health boards, the education sector, the private sector, and the voluntary sector to plan and distribute resources that match people's needs. The information collected must be "authoritative, accurate and comparable" for all parts of Scotland, and down to very small levels of geography. Only the census can consistently provide such information.

Basic information on population size, age, sex and location are crucial to work on pensions, migration, economic growth and labour supply. Other information gathered helps governments to:

  • identify housing demand and create housing supply including information on household size and family make-up which are crucial to policies on local housing demand and planning, and poor housing and overcrowding
  • identify areas of deprivation, enabling them to target services
  • gather data on equality groups, enabling them to tackle discrimination
  • gather information on housing.

Census information is also used for a range of social and economic indicators:

  • population estimates
  • employment and unemployment rates
  • birth, death, mortality, and fertility rates
  • equalities data, such as age, sex, ethnicity, religion/belief and disability.

Census data are also used by local public services to meet local needs in health, education, transport, planning, and community care services.

NRS calculated the cost to health board funding allocations if the census was not carried out in 2011. If census figures from 2001 had been used to make population estimates and allocate funding to health boards, in 2014/15 there would have been misallocations of between £30m and £40m. Some health boards would have received more, some less, than their appropriate share. (1)

Following the 2011 Census, NRS, in conjunction with the other UK Census offices, explored alternative ways to produce population statistics. NRS identified potential options and examined and compared various approaches to counting the population, both here and overseas, engaged with a diverse group of users, commentators and public bodies, and undertook qualitative and quantitative research into attitudes to the census and population statistics. More information on the work which was done can be found in the Beyond 2011 section of the NRS website.

Having considered all the evidence, in March 2014, NRS recommended that a modernised 'traditional' census was the best way to meet users' needs. Specifically, NRS announced its intention to focus on planning for a census in 2021, which would be primarily online, while offering alternative modes of completion where necessary, and also aiming to make best use of technology and administrative data in its design, building on the online approach used successfully in the 2011 census.

The main objectives of Scotland’s Census 2022 are to:

  • produce high-quality results;
  • generate outputs that meet the needs of our users;
  • maximise online response rates for the census;
  • produce timely outputs to maximise benefits;
  • protect, and be seen to protect, confidential information;
  • do so in a cost effective way; and
  • make recommendations for the approach to future censuses in Scotland.

Learning from census rehearsal

As part of our preparations for Scotland’s Census 2022, NRS undertook a public rehearsal in parts of Scotland. The rehearsal took place during October and November 2019. People living in households in parts of Glasgow City, and Dumfries and Galloway, and Na h-Eileanan Siar were asked to help by taking part, and received a letter in early October with more information about the rehearsal and how to participate.

Unlike the census itself, participation in the rehearsal was not a legal requirement. Householders in these areas were asked to take part on a purely voluntary basis to help ensure things go smoothly for the main Census in 2022. Field force and communal establishment enumeration operations were not included in the rehearsal activities and a temporary contact centre was created internally within NRS for the purpose of supporting the rehearsal.

The rehearsal also provided reassurance that our chosen approaches in many respects worked well. For example, initial contact materials and reminder letters were effective in encouraging returns, elements of our local engagement and marketing strategy tested strongly, and the overall design and functionality of the online and paper questionnaires allowed the public to complete returns and deliver usable data for our systems.

The rehearsal did importantly identify some new areas of improvement for NRS to take forward. These included the need to:

  • make improvements to how we collect address information;
  • make improvements to some online question routing;
  • review the timing and tailoring of reminder letters; and
  • improve the provision of management information.

The rehearsal evaluation report can be found on the Scotland’s Census website.

Na h-Eileanan Siar achieved a return rate of 34%, compared to the overall rehearsal return rate of 25%, which reflected NRS expectations given the voluntary nature of the event.

Barriers to participation

The numerous uses made of census data outlined above represent a key benefit and the positive impact of the census. However it is recognised that there are a number of barriers and challenges, which can potentially limit or hinder participation in the census. These include lack of awareness, lack of understanding, privacy concerns, language, mistrust in/lack of engagement with officialdom, impairments such as physical or learning disabilities, and known limitations around the ‘reachability’ of communities and groups. Some relate specifically to digital participation, such as digital access or connectivity issues, lack of digital skills or confidence, data security concerns and mistrust of digital systems. User research and testing from 2018, 2019 and 2021 has helped us understand the user experience of people who may face barriers to completing the census.

Significant market research was also undertaken in 2021, focussing on attitudes and knowledge towards the census and potential barriers to completion. More information is provided in the communications and engagement section below.

Digital participation

The public sector in Scotland is committed to respond to the changing expectations of customers by realising the opportunities that technology provides and delivering an increasing proportion of services online. Part of the Scottish Government’s Digital Strategy is to increase digital participation in order to enable social mobility and tackle persistent inequalities. The online delivery of public services will also provide services which are easier, quicker and more convenient for people to use, and at a lower cost than other methods allow. The UK Government’s Digital Efficiency Report suggests that transactions online are 20 times cheaper than by phone, 30 times cheaper than by post and as much as 50 times cheaper than face-to-face.

In general terms Scotland can be considered a digital nation. The 2019 Scottish Household Survey (SHS) reports that home internet access has increased steadily over time, reaching an all-time high of 88% of households in 2019. Previously, other sources have shown that 40% of people are reported to have a tablet computer (SCVO, 2015) and 63% use a smartphone (Ofcom, 2015a).

While this information is a useful indicator of internet availability it is not necessarily indicative of potential response to a requirement to use the internet for a specific task such as completing a census form. A report published by the Carnegie UK Trust (Carnegie UK, 2014) highlights this fact noting that the barriers to getting online are multiple, varied and complex. They state that “being digitally connected is not the same as being digitally included”. The same point was also made in a report outlining research looking at links between digital and social disengagement (Helsper, 2008) which notes “simply providing access to these platforms is not enough – digital disengagement is a complex compound problem involving cultural, social and attitudinal factors and in some cases informed ‘digital choice’”.

It is important therefore to have a full understanding of all factors influencing internet use before any assessment of potential digital participation can be made.

Everybody has their own individual set of circumstances and their own reasons for not being online. There are four main kinds of challenge people face: -

  • access (accessibility, location, cost, technology, infrastructure, language)
  • skills (literacy, digital, security, confidence)
  • motivation (risks, necessity, financial benefits, social benefits, health and wellbeing benefits)
  • trust (identity, security, standards, reputation).

The first two, a lack of access or skills result in ‘Digital Exclusion’ while the latter two, lack of motivation or trust may be best grouped with those situations where individuals have access and make use of the internet but will choose not to complete an online census as ‘digital choice’.

Both digital exclusion and digital choice could have a significant impact on online response rates. Therefore, it is important that a focus for Scotland’s Census 2022 is on promoting online participation and not just tackling digital exclusion.

We are also keenly aware of the demographics and infrastructural aspects of the digital connectivity landscape in Scotland. Households with higher income are more likely to have internet access. Households with lower incomes and households in Scotland’s most deprived areas were less likely to have home internet access than higher income households and those in less deprived areas, but the gap has narrowed in recent years. Internet access varies by tenure. 79 per cent of those in social rented housing had internet access compared with 91 per cent of households who owned their home. (2)

The option of submitting census questionnaires online was introduced for the first time in 2011 to those living in households; those living in communal establishments were only able to complete on paper. Around 20% of all returns were submitted online. The 2022 Census is being designed under the principle of ‘Digital First’ with a target online completion ratio of at least 70%.

Online services will be promoted through a number of different routes, such as community engagement activity, publicity initiatives, websites, contact materials and information leaflets. To reflect the steep rise in the use of social media in recent years, there will be a much greater emphasis on the use of social media as part of the programme’s marketing and publicity activity, to satisfy increased customer demand and expectation.

The move to a primarily online census, including a change in enumeration strategy (e.g. post out of contact materials instead of enumerator hand delivery), will reduce the direct contact between householders and field staff. Public assistance channels and services together with publicity and marketing will have a critical role in compensating for this and encouraging and enabling maximum response.

We are monitoring broadband roll-out initiatives overseen by the Scottish Government and Highlands and Islands Enterprise which have set ambitious targets for broadband coverage across Scotland. We will continue to track progress against such initiatives to develop and maintain knowledge of those localities where digital access presents the biggest challenge, so we can best channel our support and assistance efforts.

Footnotes for this section

  1. Scotland's Census 2011 General Report
  2. Scottish Household Survey 2019: Annual Report

Delivering Scotland's Census 2022

Communications and engagement

A detailed integrated communications and engagement strategy has been developed focussing on those groups most at risk of non-participation, identified by market research.

Initial market research was conducted over four phases to understand more about public knowledge about the census, what their motivations would be to help them complete the census and what messages resonate best to help promote the census. We then conducted and completed further public research in November 2020 to assess the impact of the coronavirus pandemic on public perception and knowledge of the census.

Eight key groups have been identified as potentially being less likely or able to complete the census. While we aim to reach all of Scotland through our marketing and advertising campaigns, messaging will be tailored to these key audiences using a range of platforms, including social media, PR, marketing and community and stakeholder engagement.

All communications and engagement material will be aligned to contact activity with the public.

Marketing and PR campaign

A three-phased approach has been developed aiming to reach all of Scotland, covering awareness, persuasion and action. Media will be targeted for each of the marginalised audiences, particularly in the persuasion and action phases. This will include television, radio, out of home posters and digital ads.

The creative concepts have gone through two rounds of public testing with our key audiences both in group sessions and in one to one in-depth sessions.

The marketing activity will be supported by the PR campaign which will also incorporate the three phases and again focus on those hard to reach groups. This activity will include media relations and social media.

Stakeholder and community engagement

NRS is engaging with key stakeholders, including Scottish Government, local authorities and key organisations and partners across the Third Sector, to ensure messaging about the census and its value reaches those at most risk of non-participation. This engagement will be supported by a ‘field and partnerships’ campaign to develop in-depth partnerships with stakeholders with reach to our key groups.

Online Collection Instrument

The Scotland’s Census 2022 Online Collection Instrument will be made-up of three public-facing systems: the online questionnaire, a website and a request system for ordering products. The website will provide access to the online questionnaire and will feature a wide range of help and guidance, including accessible videos and access to web-chat.

To inform the design and iterative development of the online experience, we have performed the following User Research/User Testing:

  • Accessibility Testing with Users (Dec 2018 – March 2019)
  • Audience Discovery Research (Dec 2018 – March 2019)
  • Information Needs User Research (Dec 2018 – March 2019)
  • Tree-Testing – (June 2021 – August 2021)
  • Usability testing (June 2021 – Sept 2021)

Other activities that have been performed to support the usability and accessibility of the online experience include:

  • OCI Accessibility Audit (3rd Party) – March 2020
  • Content review (3rd Party) – May 2020

Further accessibility testing/audit will be conducted by the end of 2021. You can find further information about our User Research/User Testing in Annex A.

This work has provided valuable insights into the needs and motivations of different groups and communities. These include people with digital skills limitations, low literacy, reading impairments, English language limitations, people from ethnic minorities and marginalised groups.

Scotland’s Census website

In preparation for Scotland’s Census 2022, we have developed a new website to host census results and supporting information.

The website was developed using the Digital First Service Standard, a core part of the Scottish Government assurance framework. This is a set of 22 criteria that aims to make sure that services across Scotland are continually improving, and that services are being designed with users. NRS successfully completed an assessment against this criteria before the website was launched in May 2021.

Throughout the development of the website we completed a number of user testing sessions. This included users with a variety of education levels, occupations, digital skills, locations, ages and levels of awareness of NRS and census. These sessions ensured that the service was useable and accessible for users of census data.

An example of some of the user-centred features we included are:

  • Dark mode

During usability and accessibility testing, users suggested that they found it much easier to consume information using dark mode on their devices, but that not all websites were compatible. In particular, users with dyslexia said they preferred the inverted colours of dark mode and found it easier to focus on longer paragraphs of text on a dark background. As a result of this testing we added this option to the website ahead of launch.

  • Gaelic content

Outputs from the 2022 census will be accessed through the new website. We identified a user need for Gaelic content on the website, we have discussed this with stakeholders and the feedback received will inform how we present this for Gaelic users. We will continue to develop the website this year as we work towards the census in 2022. During this time we will identify content to be presented in Gaelic on the website. The most significant part of this work will be when we create new content in 2023 as the new census data are added.

  • British Sign Language

Similar to the plan for use of Gaelic on the website we are engaging with stakeholders to plan how we use BSL with the Scotland’s Census website.

Following feedback from stakeholders, we have identified some potential development work to the website that will help us integrate BSL content. We are planning to carry out this development work ahead of outputs being published in 2023.

Alongside the website we are developing a plan to provide assisted digital support to users who require assistance accessing the census results offline.

The period between launch of the website (May 2021) and new data being released is being used to iterate and continuously improve the offline support provided by NRS.

Public assistance

A Digital First census

“Over the past 18 months, the Coronavirus pandemic has changed our way of life fundamentally. Many of us have worked successfully from home and we have come to rely on home shopping, online education and new and creative ways of using digital technology to keep in touch with family and friends.

But, it has also demonstrated the problems that come from digital exclusion. It has reminded us that whilst technology can transform lives for the better, it is essential we ensure no-one is left behind.”

In-line with the Scottish Government’s “Programme for Government 2021-2022: A Fairer-Greener Scotland” – Scotland’s Census 2022 seeks to support a digitally inclusive and connected Scotland.

Scotland’s Census 2022 is intended to be a predominantly Digital First census, with paper questionnaires only being made available on-request. We have been working with our digital delivery partner(s) to assure that the online census questionnaire is a modern, usable and accessible digital platform that meets citizen expectations of a government service.

The same standards of usability and accessibility have also been used when developing the www.scotlandscensus.gov.uk (Outputs) website.

Both digital platforms have been tested to work on different browsers and devices, and have met the criteria of the Digital First Service Standard.

Provisions have also been made to offer alternative options for census completion for those who choose not to complete online, or who cannot complete online.

Digital exclusion

Despite the pandemic resulting in an increase in digital participation and adoption - it is considered that digital exclusion may still apply to:

  • older generations and those who have poor digital access or IT connectivity issues,
  • those that may lack the digital skills or confidence to complete an online form; or,
  • those who simply do not have a device or have data security concerns about submitting a census form.

We continue to work with public sector organisations across Scotland to understand what else can be done to support these audiences who are digitally excluded.

Other barriers to participation

In addition to digital exclusion there are a number of other barriers and challenges that may limit or hinder individual participation in a digital census. This includes lack of understanding, language difficulties, public mistrust or lack of interest and engagement with officialdom, visual impairments, physical or learning disabilities and/or other known barriers around ‘reachability’ of communities and marginalised audiences.

Under the banner of “Public Assistance” the census programme has developed a number of Help and Support strategies for these audiences.

Public assistance delivery model

On account of the coronavirus pandemic, the programme has had to adapt its original Public Assistance Delivery Model and Plans.

Originally there had been the intent to create a national network of support hubs via libraries and using the physical estate of other public sector organisations, but it has been considered that this may not offer Value for Money (VfM) at this time when COVID-19 restrictions may be reintroduced preventing the effective promotion and participation at these support hubs.

Based on the lessons-learnt of what has “worked-well” from ONS and NISRA around their Census 2021 experience we are investing in our:

  • Language and Accessibility support products; we are,
  • Increasing the capacity of our contact centre operation; and we are,
  • Leveraging our stakeholder networks and community engagement activity.

Support

Description

Central services and support

Centrally, we will offer 2 primary routes for accessing Public Assistance

Decentralised services and support

Our Field Force and Enumeration teams will provide a decentralised Public Assistance offer (i.e. support and encouragement to complete your census with sign-posting to other help and support available).

Language and Accessibility Support Products

We will offer help and support in different languages and accessible formats.

Translated Guidance

Translated questionnaire guidance will be available in 16 languages to download from the website at www.census.gov.scot/languages. These translations are intended to help users complete the paper questionnaire in English.

In addition to accessing the translated questionnaire guidance online, users can contact the free Helpline number on 0800 030 8308 if they would like a printed version posted to their home.

They will also be able to request a paper copy of the English language questionnaire if they do not already have one.

Language Support Line

Support will be available in most languages over the phone, and a dedicated language helpline (0800 030 8333) has been set up to provide language support and translation services.

This service will be promoted via the Household Information Leaflet to all Households.

Gaelic (Ghàidhlig)

Individuals will be able to complete their census online by switching to Gaelic before they start to complete. This functionality will offer translations of the census questions and question help.

Key parts of the website will also be translated in Gaelic, and the following products will be available to download:

  • A ‘Gaelic Guidance Booklet’ (PDF)
  • A Gaelic translation of the Contact Letter (PDF)

Accessibility Products

Individuals will be able access help in British Sign Language, Easy Read, braille, audio and large print – to help complete their census.

British Sign Language (BSL) support 

The online questionnaire has BSL translations for each question to help BSL users to complete the census, and the website also contains BSL translations for all primary pages.

A text relay service  is also available on 18001 0800 030 8308 and BSL users can also contact us by using contactSCOTLAND-BSL.org,  Scotland’s national BSL interpreting video relay (IVR) service.

Large Print

If you have a visual impairment or struggle to read regular print, users will be able to order a large print version of the household questionnaire.

This product will also include additional guidance for completing the questionnaire in large print.

Braille

Individuals will be able to order a translation of the household paper questionnaire in braille.

Easy Read

An Easy Read guide (PDF) can be downloaded from the website, or alternatively individuals can request that a printed version be sent to them via post.

The guide tells you about the census and how to complete it in ‘plain English’

BSL, audio and subtitled question help on DVD or USB

Individuals will also be able to request

  • British Sign Language translations of the paper questionnaire on USB or DVD
  • an audio CD of the paper questionnaire questions

To order these products, you will need to let the contact centre know:

  • your name
  • address and postcode
  • how many you need

Audio CD

Individuals will be able to order an audio CD version of the household paper questionnaire.

Contact centre

Our Contact Centre will open on 28 February 2022. This will provide individuals with a free, dedicated Helpline that can be used for Help or Support when completing your census.

Our contact centre team will be trained to deal with common queries, print product requests and complaints.

The hours of operation will be:

  • Monday to Friday: 8am to 8pm
  • Saturday and Sunday: 9am to 4pm
  • 19 and 20 March: 8am to 8pm

Calls are free-of-charge from UK landlines and mobile phones.

The Contact Centre will deal with queries via social media, e-mail, webchat and IVR. They will provide basic IT technical support helping users with their login difficulties and support users with the completion of telephone captured questionnaires via the online process.

The Contact Centre will also be able to request replacement Internet Access Codes to be issued to respondents. These codes will be sent by paper, text or email.

Contact Centre and field force staff will be able to provide assistance to support completion, as well as Telephone Data Capture (TDC). This includes assistance for those seeking to complete an individual questionnaire as part of a household. In addition, the census questionnaire can be completed on behalf of the householder by a family member/friend/carer.

Field operations and recruitment

The field force which supported Scotland’s Census 2011 was in the region of around 7,500 staff who were responsible for hand-delivery of paper census questionnaires to the vast majority of Scotland’s households. In 2022 initial contact with households will be by letter and field force responsibilities will focus on following up non-response. The field force will be around half the size of that in 2011.

Field force staff will be recruited across the country and we will seek to best represent the people of Scotland within our workforce, in full compliance with relevant employment legislation.

Data collection

Respondents will be able to complete the census questionnaire online, or can request a paper questionnaire for return by post. Enumeration processes include the use of a robust address list to ensure every household receives instructions on how to make a census return. This is complemented by deployment of a field force who will seek to ensure every household and communal establishment is able to participate in the census. The Census Coverage Survey, which follows up a sample of the main operation, assesses the extent of coverage across the whole population.

Data processing and statistical outputs

Statistical data processing, and the methodology underpinning it, will seek to ensure that all data captured by the census are processed appropriately and consistently to best meet the identified user needs, and are considered throughout the data lifecycle. Statistical Disclosure Control policies and processes protect individuals, particularly those who hold less prevalent protected characteristics, from being identifiable from census outputs.

Summary of impacts identified

Statistical outputs

One of the most important aspects of the census for the islands is that the census is unique in that it is the only survey that is compulsory and covers the entire population. Stakeholders who were consulted during the Beyond 2011 programme felt that this is important in terms of response rates and ensuring extremely high coverage to provide accurate population estimates. Despite the ten-year interval between censuses, many users of islands data use the population estimates from the census as a benchmark for analysis and assurance of other statistics, which are either not available or not accurate because the numbers are very small.

Stakeholders also emphasised the importance of census data available at low geographical levels for effective service planning when working with low population density and variability between islands.

Stakeholders also felt that it is important to be able to analyse data at the lowest possible geography level, so that the unique characteristics and needs of local areas including islands could be identified. However, to prevent the disclosure of information about individuals, some islands with small populations will need to be amalgamated with neighbouring areas.

In 2022, as in 2001 and 2011, NRS plans to develop an analytical report presenting key statistics on Scotland’s island population providing a comparison with Scotland as a whole and, where possible, with previous censuses.

NRS also plans to develop an analytical report with data pertaining to the questions about Scottish Gaelic providing a comparison with Scotland as a whole and, where possible, with previous censuses. The Gaelic report will be made available in both English and Gaelic to ensure wide accessibility. Data from Scotland’s Census 2011 indicated that a high proportion of people with Gaelic language skills were residents in island council areas and as such, these reports may be of particular interest to data users from island communities. The census questionnaire will be available in Gaelic as well as English.

In preparation for Scotland’s Census 2022, we have developed a new outputs website to host Census results and supporting information.

The website was developed using the Digital First Service Standard, a core part of the Government assurance framework. This is a set of 22 criteria that aims to make sure that services across Scotland are continually improving, and that services are being designed with users. NRS successfully completed an assessment against this criteria before the website was launched in May 2021.

During development NRS identified a user need for Gaelic content on the website. We have discussed this with stakeholders and the feedback received has informed how we present this for Gaelic users.

We will continue to develop the website as we work towards the Census in 2022. During this time we will identify content to be presented in Gaelic on the website. The most significant part of this work will be completed when we create new content in 2023 as the new census data is added.

As in previous censuses, outputs will be made available for each of Scotland’s inhabited islands that meet the confidentiality thresholds for census statistics. This allows data users to access detailed information on island communities and facilitates easy comparison with other islands and areas throughout Scotland.

Census data from 2011 indicated that there are small minority populations in some of Scotland’s islands, for example small religious and ethnic minority populations. Small populations increase the risk that an individual from a minority group may be identifiable in census outputs.

As such, confidentiality constraints could mean that census outputs for island communities may have to be less detailed in comparison to other areas in Scotland of the same geographical size but with larger populations.

NRS is developing a wide ranging Statistical Disclosure Control (SDC) methodology to protect against personal information about an individual or group being discoverable from census outputs.

The NRS SDC methodology will be applied to Scotland’s island communities in the same way that it is applied to all other areas in Scotland. There will be no SDC treatment that is specific to Scotland’s islands.

NRS is planning further stakeholder engagement with data users from Scotland’s islands to determine the need for data which will inform service planning and provision for island services.

The Scotland’s Census 2022 website and associated Census outputs will comply with Part 3 of the Islands (Scotland) Act 2018 requiring Scottish public bodies to present the Shetland Islands in a manner that accurately and proportionately represents their geographical location in relation to the rest of Scotland. Similarly fieldwork maps and products to inform and support field operations will also comply with this requirement.

Digital exclusion

There are a number of barriers and challenges which can potentially limit or hinder participation in the census, particularly given the Digital First approach for Scotland’s Census 2022. These include lack of awareness, lack of understanding, privacy concerns, language, mistrust in/lack of engagement with officialdom, impairments such as physical or learning disabilities, and known limitations around the ‘reachability’ of communities and groups. Some issues relate specifically to digital participation, such as digital access or connectivity issues, lack of digital skills or confidence, data security concerns and mistrust of digital systems. It is recognised that socio-economic factors can significantly influence many of these barriers and challenges. In support of its objectives the programme is taking steps to address and mitigate these challenges.

In the specific context of Scotland’s island communities and an online census, the most significant barrier is likely to be digital connectivity. Digital infrastructure strategy in Scotland aims to:

  • deliver 100% superfast broadband access across Scotland
  • improve the availability of mobile connectivity across the region, by using linkages to broadband availability;
  • ensure the underlying infrastructure is in place to support the future growth of high-bandwidth connectivity

There is a difference (1) in coverage between rural and urban areas. Rural areas tend to have poorer coverage and slower speeds as a combination of higher installation costs and a smaller market of potential customers means there is less of an incentive for providers to invest. Scotland has some of the most challenging locations anywhere in Europe for providing telecoms infrastructure, particularly in the rural areas and the islands.

The smartphone is an important route to internet access – for many it is the most important device for going online. For some this will be because this is the only way they have of doing so privately and therefore completion of the census questionnaire via smartphone and communication of this possibility are critical, although noting that mobile data coverage may not support this aspect in rural and island areas.

Whilst the 2022 census will be predominantly online, paper questionnaires and support materials will also be available. This represents a significant mitigation against the risk of negative impact through digital exclusion. Paper questionnaires will be available on request via the Contact Centre which can be contacted free of charge, as well as from field staff following up non-responding households. Initial contact materials will clearly highlight the paper option and direct respondents accordingly, as will the census website and publicity content. Paper questionnaires requested via these channels will be sent by post and returnable by post, free of charge. All of these measures carry a cost to the public purse but the benefits of enabling free access to facilitate participation for all considerably outweigh that cost, whilst supporting the principle of fairness and reflecting the mandatory nature of the census.

The term “digitally excluded” refers to people who are not capable of using the internet, either because they lack digital skills or confidence in using a computer and online services and/or they do not have access to the internet. (2) Non-use of the internet could be due to many factors including:

  • lack of digital skills to safely and competently use online services
  • lack of confidence or interest in using a computer or online services
  • no or slow access to an internet connection
  • no access to devices or assistive technologies necessary to use the internet.

Digitally excluded groups are more likely to be:

  • Those over 65 years of age (3)
  • Economically inactive working age adults, lower income households, lone adult households, people in communal establishments or other non-private housing (4)
  • Disabled people (5)
  • People on lower incomes and households in locations without fibre broadband internet access. (6)

These are the groups where greater encouragement to complete online may be needed or greater awareness of support available and alternative methods of making a return may need to be generated.

Digitally excluded people will need assistance of some form to respond to the census and in order to best provide assistance NRS must determine who these people are and which areas of Scotland they live in, to enable appropriate services to be targeted towards areas that are most affected.

Scotland’s Census has undertaken research around the production of a Digital Exclusion Index (DEI) to identify and analyse those communities and localities in Scotland most at risk of non-participation in census due to digital exclusion factors. Although the DEI was produced before the coronavirus pandemic, in its current form it is likely to still have high predictive power, as the demographic factors on which it is based still predict likely barriers to digital participation. This work will provide valuable background on a range of operational aspects and help us better support people who face barriers to completing the census questionnaire online.

Field operations and data collection

The DEI will provide a valuable evidence-base to develop public assistance and field force policies, including resourcing, logistics and potentially reactive interventions during live operations. Translated guidance will be available in 16 community languages, including Gaelic.

We are actively working with our recruitment supplier to recruit people with written and verbal Gaelic skills. Printed media will be used for job advertising in areas of digital exclusion (typically socio-economically disadvantaged groups, rural areas and the island populations).

Whilst there are travel-related factors affecting field force activities in island communities, (e.g. lack of public transport, remote locations) these are not exclusive to islands and will not result in any differences in overall approaches to enumeration or fieldwork for those communities and localities.

The Field Force will provide dedicated support throughout the islands. We aim to recruit field force staff who possess written and spoken Gaelic skills and recruitment processes will directly engage education and media outlets which can help to support this aspiration.

Additional live translation services support will be available through our contact centre.

We have appointed a Regional Manager, based in Na h-Eileanan Siar, who will help bring local knowledge to our operational plans and support stakeholder engagement and partnerships throughout the highlands and islands.

We have appointed Area Managers based in Argyll & Bute, Highland, Na h-Eileanan Siar, Orkney and Shetland Islands to support island communities at local authority level.

NRS will seek and respond to feedback received from community and stakeholder engagement as well as ensuring travel policies, working patterns and training are all fit for purpose and work well for all areas.

Communications and stakeholder engagement

As facilities used by NRS and the Scottish Government are primarily located in Edinburgh and Glasgow, it is more difficult to engage directly with stakeholders from island communities. NRS has sought to engage with stakeholders from island communities by hosting events outside of the central belt. Materials from events and surveys on plans for census questions and outputs are made available in hard copy and online via the Scotland’s Census website to ensure that those unable to attend events are still able to engage and offer feedback.

Engagement is ongoing in the lead up to 2022 with Scotland’s six local authorities which encompass island communities (Comhairle Na h-Eileanan Siar, Orkney Islands Council, Shetland Islands Council, Argyll and Bute Council, North Ayrshire Council, Highland Council) to understand the barriers affecting different groups across different localities and how best to communicate and engage with these groups. As mentioned earlier in this report, Na h-Eileanan Siar was one of the in-scope census rehearsal areas and close collaboration with the local council and a wide range of community stakeholder organisations took place prior to the rehearsal and will continue to 2022.

NRS has established active working relationships with a range of key stakeholders from the Gaelic speaking community including Bòrd na Gàidhlig and Comann na Gàidhlig as well as academics and council representatives who have provided valuable feedback and input to our design development processes.

Individuals will be able to complete their census in Gaelic online by switching to Gaelic before they start to complete. This functionality will offer translations of the census questions and question help.

Key parts of the website will also be translated in Gaelic, and a ‘Gaelic Guidance Booklet’ (PDF) and a Gaelic translation of the Contact Letter (PDF) will be available to download.

NRS undertook a period of consultation throughout September 2019 for each of the Impact Assessments accompanying the Census Order. Impact Assessments have been updated to reflect feedback where appropriate. A report on the consultation was published on the Scotland’s Census website.

Online Collection Instrument: User research

User research to support the development of the online data collection instrument specifically targeted Gaelic speakers, among a range of audiences, to enable insights and feedback around expectations and aspirations for Scotland’s Census 2022.

A summary of this work and its outcomes can be found at Annex A.

Conclusion

NRS has considered all relevant impacts around island communities in the design of Scotland’s Census 2022 and as discussed throughout the document, mitigations are in place to reduce impacts wherever possible. We are very grateful to all of our stakeholders who have informed planning and design of Scotland’s Census 2022.

Footnotes for this section

  1. https://www.ofcom.org.uk/__data/assets/pdf_file/0022/108814/scotland-connected-nations-2017.pdf
  2. ONS, ‘Exploring the digital divide
  3. Exploring the UK’s digital divide - Office for National Statistics (ons.gov.uk)
  4. Exploring the UK’s digital divide - Office for National Statistics (ons.gov.uk)
  5. Exploring the UK’s digital divide - Office for National Statistics (ons.gov.uk)
  6. The Digital Divide: What does the research tell us? Cambridge Centre for Housing and Planning Research, 2020

Authorisation

Name: Paul Lowe

Role: Registrar General

Date: December 2021

Annex A - Online Collection Instrument: Research

Accessibility testing research summary

The Online Collection Instrument (OCI) delivers the core question set for the census. There was a need to conduct some initial accessibility testing on the early version of the site to identify any early issues. We conducted a round of accessibility testing with 10 participants with a variety of disabilities from December 2018 – March 2019.

Around half of the participants were visited in their home in order to allow for the use of any specific assistive technology such as screen readers and magnifiers and to help make them more comfortable.

From the OCI, we tested:

  • On-boarding – entering Internet Access Code (IAC), setting up a password and password recovery.
  • Questions H1-5 – details of who is in the household

Participants ranged from 20 to 61 years of age and had a range of disabilities and assistive technology needs, including dyslexia, dyspraxia, autism, blindness, arthritis, detached retina, macular degeneration, Friedreich’s ataxia.

Key findings

The majority of participants found it relatively straightforward to get through the on-boarding and H1-5 sections of the prototype. They were very positive about the idea of completing the census online as it meant they would be able to complete it in a format best suited to them, save progress and complete it in their own time.

However, there were a number of overarching issues that affected all types of users. These were predominantly usability issues, but some assistive technology specific issues were encountered as well. Usability issues will cause problems for all users, but they are heightened for disabled people and users of assistive technology. Causing confusion, frustration and being slowed down can have a significant impact on these users. In some situations it can cause stress/anxiety and lead them to seek support with completion or make them feel like they don’t wish to continue. Many of the participants had to stop to ask the moderator what was meant or required and some needed to be told how to progress to the next step.

Additionally, while the questions in this version of the prototype were not the final 2022 question set, a number of usability issues were uncovered that will be important to consider independent of the question content and can be worked on and resolved for subsequent rounds of usability testing.

The key issues identified included:

  • unclear error messaging when creating a password
  • ‘set up password recovery’ usability and error messaging
  • users having difficulty understanding what’s being asked for in the ‘temporarily away’ question
  • users having difficulty understanding what is being asked for in the ‘visitors’ question
  • confusion caused by the ‘dashboard’ when users land on it for the first time
  • unclear or missing instructions or supporting text – e.g. needing to use capitals and hyphens in the IAC code
  • the IAC code was challenging for many

Findings specific to assistive technology were identified:

  • Zoomtext issues: participants who used screen magnifiers appreciated the amount of space on each page and having single questions per page.
  • Screen reader issues: participants who used screen readers had very different experiences. This could be for a number of reasons such as version of software, device used or level of users’ experience with assistive technology.

Additional findings:

  • Some users may not be able to read the letter, the service needs to consider how blind people living on their own can be supported.
  • Some users will require a large print letter to be able to read the IAC number, consider how they can be easily identified and provided with the right information. Is there any way of knowing about this need before sending the letters out?
  • When the initial letter will be sent out to give citizens enough time to get right version of information that they need, and also how any reminder services may come through to them (i.e. reminder letters are inappropriate for a blind person).
  • Some users will misplace or lose the letter and so how they can still access online without the IAC code will need to be considered and made clear to users.

Information needs user research summary

This research, to understand whether the digital version of the 2022 Census meets the needs of citizens, comprised of usability and accessibility testing from December 2018 – March 2019, conducted by the Scottish Government Digital Transformation Division. While these sessions predominantly focussed on the use of the digital components (i.e. the website portal and the ‘online collection instrument’ (OCI)), we also discussed what information participants expected or felt they would need in order to take part in the census at various points, including showing a version of the letter to set context.

The main findings from these sessions are regarding usability and accessibility, which have been reported via the ‘OCI User Testing’ strand of work, but broader insight around information needs have also been uncovered. In order to further understand information needs for citizens we utilised a number of sessions to explore the following objectives:

  • Understand what information is required by a user to support them in their census experience.
  • Understand what channels users expect to be able to access information to support them in their census experience
  • Review of the current language and terminology to determine whether it supports the user’s understanding of the information they need in order to complete the census
  • Understand how the user’s need for information changes over their census collect experience.

Key findings:

  • Standard patterns for question pages: reduces cognitive load which may quicken response
  • Explanation and narrative to set expectations and orientate users within the form would benefit some users
  • In a small number of cases there was misunderstanding of the questions
  • Type ahead functionality for industry and occupation questions caused particular problems in choosing an answer
  • Hard validation meant users got stuck in a loop where they could not answer a question and so could not submit their census response
  • Problems accessing Help and Support while in the questionnaire
  • Age related question routing meant some questions are asked of children within the household that are not relevant for a child
  • Misunderstanding of questions or uncertainty about how to answer.

Findings are informing further development of OCI and the question engine to maximise respondent ease and minimise respondent burden.

Audience Discovery Research - Qualitative research among ‘seldom heard’ audiences

  • To investigate their needs and inform the design of the process and website for Scotland’s Census 2022.
  • Research to provide a deep and robust understanding of user needs – with a specific focus on those users who have specific situations for Census collection or who require Assisted Digital support.
  • The purpose is to ensure that these users’ needs are accurately represented in the design of the OCI: -
    • Flat / House Sharers
    • Communal Establishments
    • Communities with Reduced Links
    • Ethnic Communities (sample included Somali, Roma, African, Romanian, Kurdish)
    • Religious Communities (sample included Sikh, Muslim)
    • Other Communities (Camphill)
    • Skill Limitations
    • Digital Disengagement
    • Low Literacy Skills
    • Reading Impairment
    • Supported Applications
    • English Language Limitations
    • Gaelic Speakers

With a focus on exploration and discovery, the detailed research objectives were:

  • Develop a deep knowledge of who the service users are in terms of their circumstances, situations, attitudes, skills, abilities (as appropriate)
  • In relation to officialdom generally; in relation to the Census specifically
  • To what extent information and support are/are not accessed
  • Understand motivators and barriers to completing the Census
  • Comprehension of the Census; its (perceived) importance
  • Personal obligations
  • Identify the support and interventions that would facilitate participation in the online Census
  • Information needed, support needed, enumeration needs
  • Explore perceptions of and reactions to the OCI design
  • Aspects that help and hinder completion
  • Identify how the above should be reflected in the OCI, and in general, to ensure a successful Census

Situations and skills

  • Broad spectrum of situations: some people have thrived in Scotland, some have struggled.
    • Positive experiences can inspire appreciation of Scotland / its government, and willingness to comply with officialdom.
    • But some feel let down by the system and less willing to comply.
    • Others fear the authorities and sharing personal information.
  • Broad spectrum of skills and skill levels across Digital, English Language, Reading Impairment, Literacy.
    • Low skills don’t seem to necessarily correlate with a less positive life experience.
    • Key factor seems to be whether the family or household unit perceives it’s ‘doing well’.
    • Possible exception: low Literacy Skills might have a stronger correlation with feeling let down by the system, that life has been impoverished (unnecessarily).

Support

  • People with lower skills tend to have an established support network
    • Family, friends, Community Leaders and Organisations etc they trust and turn to for help / advice.
    • Many need ‘hands-on’ support with officialdom in general, English translation, reading and writing, or digital activity.
  • Hands-on support is likely one of the most important success factors for the Census
    • Providing the skills that are missing…and also overcoming low motivation / mistrust / scepticism.
  • Reaching out to Community Leaders and Organisations is vital
    • They are close to their communities, strong advocates of the Census, and very keen to help.
  • Like the general population, some people have stronger skills and will do well with ‘self-serve’ support available from their network or on the website.

Attitudes to the Census

  • A spectrum of engagement with the Census.
    • A few ‘evangelists’, e.g. Community Leaders and Managers of Community Establishments.
    • Some people are mistrustful or resistant, likely due to personal experience.
    • Most seem to be around the mid-point: willing to carry out their legal obligation, but might not perceive the value of the Census.
  • Opportunity to improve engagement for the greater success of the Census – quality of experience for the public as well as quality and accuracy of information.
    • Many simply don’t know much about it – what it’s for, what it stands for, the difference it can make.
    • Improving understanding tends to improve engagement.

The letter

  • The letter presents significant difficulties for people with lower skills
    • What’s it about? What does it mean? What do I need to do? Do I have to?
  • Indeed, for many, the letter is ‘daunting’ to read – many won’t see it through to the second page and will seek help.
  • It conditions expectations that participating in the Census will be difficult – too difficult to attempt.

The website

  • By contrast, when people see the design for the website, confidence builds.
  • Some now feel they will ‘have a go’ under their own steam, seeking help if needed, and look forward to a sense of achievement.
    • So, it’s important to make the process (seem) easy in order to optimise autonomous participation.
  • The website design creates a pleasing and reassuring atmosphere.
    • Excellent use of colour, space, imagery (people), and nuggets of text to increase engagement and reduce cognitive effort – and suggest it’s easy.
    • Wears its official credentials lightly.
    • Surprisingly and positively different from the letter and much official communication; should play a central role in shaping engagement.

User testing – August/September 2021

A further round of user testing was performed across August and September 2021. The testing was designed to test the end-to-end user journey across six key audience groups:

  • Single-family households
  • Multiple-family households
  • First-time census completion
  • Low digital literacy
  • Marginalised groups
  • Low trust in government

The testing was conducted completely online due to the COVID-19 pandemic.

Results from the testing provided NRS with:

  • insights into completion challenges
  • user expectations versus the reality of online experience
  • potential content and help refinements

As a result of the testing, there have been:

  • updates to content to provide more clarity to users
  • new content commissioned to support users understand and use the service
  • refinements to some layout and design to improve usability

A further accessibility audit will be conducted on the online system in November 2021. This will identify any further refinements needed to ensure the online experience is as accessible as possible.