Scoping

Project phase

Identify where you are in the in your project, in particularly in relation to the development or use of a digital component.

Scoping

Digital technologies and solutions used

Identify where you are in the in your project, in particularly in relation to the development or use of a digital component.

Scoping

Digital activities

Identify where you are in the in your project, in particularly in relation to the development or use of a digital component.

Data-related activities

Responsible data handling

Data-related activities

Privacy impact assessment

Data-related activities

Sensitive data

Data-related activities

Informed consent

Data-related activities

Informed consent for data processing

Data-related activities

Data minimization

Data-related activities

Anonymized data

Artificial Intelligence, automated decision-making and machine learning

AI application

Artificial Intelligence, automated decision-making and machine learning

Bias in datasets

Artificial Intelligence, automated decision-making and machine learning

Biased outcomes

Artificial Intelligence, automated decision-making and machine learning

Gender-based analysis

Artificial Intelligence, automated decision-making and machine learning

Post-deployment testing

Risk analysis

Risk profile of project

Context related topics

Data protection legislation in project country

Context related topics

Lessons learned from similar projects

Context related topics

Human rights impacts of previous projects

Context related topics

Human rights impacts of previous projects

Unintended consequences

Unintended consequences

Vulnerable and marginalised groups

Vulnerable groups

Vulnerable and marginalised groups

Potentially impacted rightsholders

Vulnerable and marginalised groups

Users as individuals

Accessibility

Accessibility

Accessibility

Monitoring

Stakeholder engagement

Engagement on potential impacts

Stakeholder engagement

Engagement with rights holders

Stakeholder engagement

Engagement with rights holders

Stakeholder engagement

Engagement with rights holders

Transparency and reporting

Reporting

Transparency and reporting

Reporting

Access to remedy

Remedy

Progress

0%

Where are you in the project phase?

Please select the project phase that you are currently in while using this tool.

Comment - Design

Use the tool during the project design phase as an early guide on how to avoid human rights risks relevant to later stages of the project.

Comment - Implementation

Use the tool o inform decision-making around specific digital project components and to ensure a human rights-based approach to those decisions.

Internal resources

  • GIZ description of different project phases

For a deeper dive

  • Example 1

Placeholder text

Does the project include any of the following digital technologies or solutions?

Comment - e-learning

E-learning or other forms of virtual and digital learning will often include some form of data collection. This can include collection of personal information if there is gated access to the platform, and can also include collection of other data linked to specific responses, response times etc. Data from participants and users may also be analysed and processed in different ways. Consider what kind of digital activities your specific component includes.

Comment - IoT devices

Internet-of-Things (IoT) devices facilitate real-time collection, sharing and analysis of data. If IoT devices are connected, this can include complex analysis of data from various sources. IoT devices can be used for remote monitoring, predicting maintenance needs, resource management.

Comment - Digital social/ communications platform (incl. social media)

Digital communication platform use can have many varied impacts. This includes: impacts to the freedom of expression if content is deleted or demoted without regard to freedom of expression; impacts on the right to health if the platform is used to persecute human rights defenders; right to privacy if data is collected without the knowledge of the individuals; and many more.

Risks may be elevated if it concerns “business to customer/user” or “government to citizen” platforms. Examples include use of social media for civil society engagement, e-medicine platforms etc.

Comment - Cloud services

The use of cloud services will naturally include different forms of data processing, including data collection and data storage. This means that particular attention must be paid to the data protection regulations and standards in the relevant context.

Does the project and/or component include any of the following activities? (Either by GIZ or by implementing partners)

Digital projects or components can be made up of a variety of products and services, which include a large variety of different digital activities such as: e-participation platforms, e-learning tools, mobile reporting mechanisms, big data analysis, text message-based health apps (e-health), and many more. For more information about the response options, select the relevant option and see the comment.

Comment - I don't know

It is important for project staff to understand the underlying technology of digital components, in order to assess their impacts. The tool will still let you proceed, but will not include activity-, product- or service-specific questions.

Comment - Data collection

This option implies that the project component somehow is developed to collect data digitally. This may include projects focused on public participation where information of individuals’ opinions related to government practices is linked to identifying information of the individual.

Collecting data may cause a series of impacts, the most obvious being the right to privacy, if there e.g. was no consent from the data subjects. However, the ‘threat’ of collecting data without consent may also have impacts on e.g. the freedom of expression since individuals do not want to share their opinion if that data is being collected.

Comment - Data storage

Data storage is naturally linked to data collection, since it relates to what happens to the data after it has been collected. This includes e.g. having a database of all learners that have participated in an e-learning project. It may in some cases be possible that data collected simply is not stored, or that it is stored elsewhere and by someone else.

Data storage in itself may primarily impact the right to privacy, particularly if there are risks of data breaches. Even when there are legitimate reasons to store data, storing that data for an excessive period of time can raise significant right to privacy concerns.

Comment - Data alteration, treatment or use

This activity relates to how the data is used. While it is possible that nothing is done with the data except for storage, often times digital data collection has the purpose of using the data to e.g. analyze patterns, make predictions, and so forth. One example is the analysis of large amounts of data to forecast disease outbreaks in a country.

Data alteration, treatment or use can have far-reaching impacts on human rights depending on the context. It may include using big data analytics to make predictions that end up being discriminatory. Another example: If health centers use data to improve efficiency, small errors may have severe impacts on the right to health.

Comment - Data sharing

Data sharing simply means to share data that has been collected with others. This often occurs in relation to research where data used for research is made available to other researchers.

First and foremost, data sharing may have impacts on the right to privacy, if the individual did not provide her/his informed consent. Further, the data shared might be used for purposes such as targeted advertising, which may among other things have discriminatory impacts.

Comment - Hosting and/or sharing user-generated content

This relates to having a platform that is made available to a certain users and where these users generate the content. This can include e-learning platforms where learners develop certain digital content, and could also concern digital communication platforms for e-participation.

Simply hosting or sharing content can also have impacts. If hate speech is hosted on a platform, this may have negative impacts on the right to mental health. If certain discriminatory content is shared, that naturally can have impacts on the freedom from discrimination.

Comment - Artificial Intelligence (AI) /machine learning

While there is no shared definition of AI, it generally concerns the science and engineering of making intelligent machines, especially intelligent computer programs. It includes the likes of voice and face recognition, self-driving cars as well as machine learning algorithms that can help predict weather patterns, droughts or even criminal activity.

Artificial intelligence have many use-cases and can therefore have a large variety of impacts. This ranges from: impacts on the right to a fair trial when AI is used in judicial systems; impacts on the right to equality and freedom if outcomes are biased to the detriment of vulnerable groups; impacts on the right to health if AI-supported e-medicine platforms make sub-par decisions; impacts on the right to an adequate standard of living if AI-supported fast-track approvals for unemployment benefits are limiting the access to such benefits for certain groups; impacts on the right to privacy and many other rights in relation to COVID-19 track and tracing apps.

Caution - No

The activities listed are the ones that this HRIA tool is aimed at. Since your answer indicates that no such activities are taking place, the guidance ends here. This may for example be the case if your project component is about digital technologies, but it does not itself use such technologies (e.g. face-to-face education on digital literacy). Feel free to check the “other” box in case you would like to continue through the other steps of the tool.

Has the project or component implementation been assessed using the Responsible Data Guidelines checklist?

In many cases, this will have been the case. If you are unsure, consult with colleagues who might have been involved in such a process, as well as the further resources for a reminder on the content of the checklist.

Recommendation - No

Review Responsible Data Guidelines checklist as soon as possible.

Recommendation - Yes

Review and update the assessment, and move on to pay particular attention on stakeholder engagement and vulnerable groups.

Recommendation - I don't know

Consult with project partners and others involved with the digital component and see whether the Responsible Data Guidelines have been used.

See Responsible Data Guidelines, including checklist

Have you completed a privacy impact assessment, Data Protection Impact Assessment, or similar, in relation to the digital project or component?

Depending on the specific digital components you may have already been required to conduct some forms of impact assessments, such as privacy impacts assessments or data protection impact assessments. These assessments can serve as a great starting point when you are looking to assess the full range of human rights potentially impacted by the project. For example, while some privacy aspects might be covered it might not address certain impacts related to discrimination but it can benefit the futrher analysis that some aspects of the digital component have already been assessed.

Comment - Yes

Review the previously conducted assessments and consider whether the human rights aspects provided in this tool are sufficiently covered. Update the old assessment as relevant.

Potentially impacted human right and principles - Not yet. It is underway.

Right to privacy

Recommendation - Not yet. It is underway.

Review planned privacy impact assessment and consider how human rights can be better integrated into the assessment.

Potentially impacted human right and principles - No, there are no such plans.

Right to privacy

Recommendation - No, there are no such plans.

Conduct some form of privacy impact assessment, taking point of departure in data protection impact assessment according to the EU General Data Protection Regulation (GDPR), while also looking at human rights generally.

Comment - No, there are no such plans.

Even if the specific project or component does not require such assessments, it can be useful to use the structure of those assessments to inform assessments of potential human rights impacts. See further resources for examples.

Recommendation - I don't know

Consult with project partners and others involved with the digital component and see whether any form of privacy impact assessment has been conducted.

  • Alessandro Mantelero, “AI and Big Data: A Blueprint for a Human Rights, Social and Ethical Impact Assessment”, Aug 17, 2018: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3225749
  • Upcoming piece on DPIAs and human rights from University of Essex; Human rights, big data and technology project.

Does the project collect, store or otherwise process sensitive data?

Sensitive data is data that reveals certain specific features or information of an individual, this includes:
- Racial or ethnic origin
- Political opinions
- Religious or philosophical beliefs
- Trade union membership
- Genetic data
- Biometric data for the purpose of uniquely identifying a natural person
- Health data, including information about a person’s sex life
- Sexual orientation

It is also important to note here that AI can be applied to infer and generate sensitive information about people from various sources of non-sensitive data.

Potentially impacted human right and principles - Yes

Right to privacy

Recommendation - Yes

The processing of sensitive data means that there is a strong need for a human rights-based approach to the project, taking point of departure in the potentially impacted individuals. Ensure that such a process is in place and revisit existing impact analyses.

Comment - No

The fact that no sensitive data is collected, stored or otherwise processed implies a lower risk in terms of potential human rights impacts.

Comment - I don't know

Consult the further resources (especially Responsible Data Guidelines and related documents) and engage with project partners and others involved in data processing, and ask whether sensitive data is processed.

See Digitalisation in Development Cooperation Toolkit and Responsible Data Guidelines, where there are checklists around the handling of sensitive data.

Have you ensured that all data subjects have been fully informed about the collection and use of data, so that they have been able to provide their informed consent to such collection and use?

It is important to note that people often are unable to fully understand how data is collected, what kind of data is stored and how, exactly, that data is used. A simple digital checkbox to provide consent might not imply that the individual has been informed and fully understood his or her consent. Research shows that many individuals do not feel in control over the data that is collected about them, see more in further resources.

As such, in relation to medium- to high-risk applications of digital components it is particularly relevant to ensure that data subjects have fully understood what data is collected.

Potentially impacted human right and principles - No

Right to privacy, right to freedom information and right to participation

Recommendation - No

Review your efforts to inform data subjects of how their data is used, as well as the processes in place for them to provide consent. Engage with data subjects to assess how these efforts can be improved.

If you are not collecting the data yourself, discuss with the partners that are collecting the data how the data is collected and how consent is given by the data subjects.

Recommendation - I don't know

Engage with project partners and others involved in data processing, and ask whether informed consent has been achieved for data collection and processing, and how that has been achieved (if relevant).

Comment - Yes

While having gotten consent is essential, it is also important to assess whether the consent provided has been free and informed. In some cases, it is doubtful whether consent has been given freely, particularly if the option of not providing consent was not a realistic option in practice.

Please explain on how this has been achieved: (write your comment in the grey box)

Considering the difficulties in achieving adequate informed consent from data subjects, it can be an important exercise to reflect on how, exactly, such consent has been achieved.

Does the project or component strictly follow the principles of data minimization?

To follow the principle of 'data minimisation' means that data collected, used or stored should be adequate, relevant and limited to what is necessary for the intended purposes. While it is common that data anonymisation is used to lower the risks to the right to privacy, it is also important to emphasise the need for data minimisation. This is partly because (pseudo-)anonymised personal data can be re-identified by combining that data with other data.

Comment - Yes

That means that risks related to the right to privacy have been significantly reduced. Continuously assess whether the amount and type of data collected and used should be changed.

Potentially impacted human right and principles - No

Right to privacy

Recommendation - No

Review your data processing practice and ensure that data minimization is ensured, since this can significantly lower human rights risks.

Comment - No

Minimizing data can include e.g. initially collecting limited amounts of data as well as developing sunset clauses that ensure that data is only kept for a limited period of time after which it is deleted.

Comment - I don't know

Consider the following examples:
(1) a ‘smart’ public employment service automatically sends job-seekers a general questionnaire, which includes specific questions about health conditions that are only relevant to particular manual occupations. It would be irrelevant and excessive to obtain such information from an individual who applied for an office job. Data must thus be minimized.
(2) an online classroom is set up for remote education during school closure. Parents are sent a general questionnaire, which includes questions about health conditions in order to assess accessibility questions. However, only certain disabilities are relevant and to obtain further health information is excessive. Data collection and storage must thus be minimized.

Is there a risk that personal data that has been anonymized can be made into personal data again (i.e. by combining various data sources)?

AI can be used to re-identify the individuals that are linked to anonymised 'individual data' by combining a vast amount of data sources and data points. As such, the risks to the right to privacy can remain even after data has been anonymised. It is therefore important to consider whether such risks have been taken into account, and if so, what measures have been put in place.

Potentially impacted human right and principles - Yes

Right to privacy

Recommendation - Yes

Review whether data collected and used could be further minimized. Revisit this as the project progresses since it may be possible to identify unnecessary data at later stages of a project, which was not possible initially. Also important to review how collected data might be or is shared to third-parties, since that may increase the risk of de-anonymization.

Comment - No

There is often some risk of this occurring (see further references), and as such it is important to continuously review this risk as data is considered to be shared with third-parties.

Potentially impacted human right and principles - I don't know

Right to privacy

Comment - I don't know

See further resources for more information on re-identification of personal data.

Which kind of AI application is used in the project?

There are many forms of AI applications, some of the most common include:

- Image and object recognition: The analysis of large data sets to automate the recognition, classification, and context associated with an image or object. This includes the likes of face recognition but also analysis of vast amounts of satellite photos in order to predict migration patterns.

- Text and speech analysis: The analysis of data sets to recognize, process, and tag text, speech, voice, and make recommendations based on the tagging. This may include text-to-speech technologies that can help blind individuals with accessibility of written content.

- Risk assessment: The analysis of large data sets to identify patterns and recommend courses of action and in some cases trigger specific actions. This may include e.g. automated credit risk scoring by banks, or recidivism risks in a justice system.

- Content generation: The analysis of large data sets to categorize, process, triage, personalize, and serve specific content for specific contexts. This may include e.g. automatically generated news media pieces based on AI review of other news sources.

- Process optimization & workflow automation: The analysis of large data sets to identify anomalies, cluster patterns, predict outcomes or ways to optimize; and automate specific workflows. This may include e.g. chatbots that can help to assess which users are in need of more extensive assistance and those who can be redirected to FAQ parts of a website.

- Other: This option is included in order for you to have the opportunity to explain which kind of AI application is used in your project.

Comment - Image and object recognition

Image and object identification risks negatively impacting the right to privacy. Particular attention should be paid to the datasets used, how the data is collected, and how the recognition technology functions. Facial recognition technology may for example have far reaching consequences on the right to privacy, freedom of assembly, right to a fair trial, and many other rights.

Comment - Risk assessment

Algorithmic risk assessments make predictions of risks based on historical data. If previous risk assessments have been biased, the predictions made by the algorithm will also be biased unless the bias is corrected. It is therefore important to keep that in mind, since if such risk assessments inform decisions that may have significant impacts on rightsholders the outcomes might have severe impacts on human rights. This might be the case when risk assessments are used within judicial systems, or in relation to decisions on whether an individual may receive public benefits or not.

Comment - Process optimization and workflow automation

Process optimization and workflow automation may in general not pose great risks to human rights if they specifically concern administrative tasks. However, process optimization and workflow automation can also be used to speed up decisions concerning social assistance, issuance of permits, or other forms of licensing, which all might have impacts on human rights depending on the specific decision. More importantly, issues may occur as the underlying AI model is difficult to explain and understand, which thereby makes it difficult to appeal, leading to potential impacts on the right to a fair trial and access to remedy.

Comment - Text and speech analysis

Potential human rights impacts related to text and speech analysis includes public service chatbots that are not able to assist individuals from minority groups who do not speak the main language in a country. Language assistants that are perceived as human may also cause distress for individuals using the service.

Comment - Content generation

Content generation can naturally take place in many forms. From spreading generating content based on official government statements, to the answers from ‘smart chatbots’. The impacts of content generation wholly depends on the content generated. Examples of human rights impacts include if the content generated feeds into other AI systems, making the entire process highly opaque and difficult to understand, potentially rendering decisions that no one knows the reason for.

Are there processes in place to assess biases in datasets?

AI tools are only as good as the data they rely on. It is therefore important to continuously assess whether the data is valid, reliable, current, sufficient etc. Existing data that is biased or discriminatory is going to produce results that are bias or discriminatory. It may be necessary to discuss the question of bias with the developer of the digital component in order to respond to the question.

Comment - Yes

That means you have considered one significant aspect of potential negative human rights impacts.

Potentially impacted human right and principles - No

Right to equality and freedom from discrimination

Recommendation - No

Plan and conduct an assessment of potential biases in the datasets. See further information for help on how that could be done in the resources section.

Recommendation - I don't know

Consult project partners and other third-parties involved in the development of the AI model. If they are not aware of any processes to assess biases in datasets, it is likely that bias has not been assessed.

Are there processes in place to assess biases in (unexpected) outcomes related to AI predictions and outputs?

Similar to the previous question, it may be necessary to discuss the question of bias with the developer of the digital component in order to respond to the question. See further resources for more information about blindspots in AI application.

Comment - Yes

That means you have considered one significant aspect of potential negative human rights impacts of automated decision-making systems.

Potentially impacted human right and principles - No

Right to equality and freedom from discrimination

Recommendation - No

Plan and conduct an assessment of biases in outcomes related to the outputs of the AI. See further information for help on how that could be done in the further resources sections.

Recommendation - I don't know

Consult project partners and other third-parties involved in the development of the AI model. If they are not aware of any processes to assess biases in outcomes, it is likely that bias has not been assessed.

Have you undertaken specific gender-based analysis of the implementation of the project or component(s)?

There are many aspects to this question. It may include considering the potential gender discrimination in the predictions made by an AI model, as well as considerations of the gender digital divide and what that divide means for the outcomes of the project and the use of the digital components. See further resources for further information about different aspects related to gender that should be considered in the project implementation of a digital component.

Comment - Yes

That means you have considered one significant aspect of potential negative human rights impacts of automated decision-making systems.

Potentially impacted human right and principles - No

Right to equality, freedom from discrimination and women’s rights

Recommendation - No

Plan and conduct a gender-based analysis of the implementation of the project or component(s). See further information for help on how that could be done in the further resources section.

Recommendation - I don't know

Consult project partners and other third-parties involved in the development of the automated decision-making system. If they are not aware of any specific gender-based analysis of the system, it is likely that this has not been assessed.

Has the automated decision-making system been tested for accuracy and effectiveness after its deployment, or is there a clear plan for post-deployment testing?

Comment - Yes

Constant monitoring, evaluating and retraining are essential practices to identify and correct embedded bias and disparate outcomes.

Potentially impacted human right and principles - No

Right to equality and freedom from discrimination

Recommendation - No

Develop a plan and test the automated decision-making system for accuracy and effectiveness after its deployment.

Comment - No

Even the most well-intended algorithms can have unintended consequences. Constant monitoring, evaluating and retraining are essential practices to identify and correct embedded bias and disparate outcomes

Recommendation - I don't know

Consult project partners and other third-parties involved in the development and/or deployment of the automated decision-making system. If they are not aware of any such processes, it is likely that the system has not been tested for biased or discriminatory outcomes after its use and deployment.

Is the project or component related to a high-risk sector or public service delivery?

High-risk sectors include any sectors where decisions taken can have severe impacts on individuals. This includes sectors such as:
- Healthcare
- Transport
- Energy
- Digital infrastructure
- As well as public service delivery, including: asylum, migration, border controls, judiciary, social security, employment services.

This is a non-exhaustive list, and it is important that you consider whether your specific sector is of high-risk.

Comment - Yes

If the project implementation concern a high risk sector or public service delivery, extra cause should be taken in relation to any application or development of digital tools or services, since the potential human rights risks may be severe.

Comment - I don't know

Consult the further resources listed, and consider whether the sector in question is high-risk or not. In case of doubt, consider answering yes to the question since that still implies that risks may be high.

Comment - No

If not in a high-risk sector or public service delivery, the project can in principal be considered low-medium risk, unless the specific application is highly sensitive.

  • See EU Commission, “White paper on AI”, page 17.
  • See further resources outlining potential high-risk sectors.

Is the project or component applied in a way that significant risks are likely to need to be addressed?

See the examples of risks related to your previous response about the kinds of digital activities within your project component.

The question is important because it reflects the idea that not every application or use-case of digital technologies, products, services, tools etc., involve significant risks. As an example, employment and unemployment services can be considered a sensitive sector which warrants extra attention, whereas if AI models are used to improve scheduling of meetings with those seeking unemployment benefits, this is unlikely to imply significant risks to human rights. If, on the other hand, AI models were used to predict the likelihood on successful job applicants and thereby determine resource allocation to 'better candidates', potentially significant risks to human rights are at stake.

See more examples in further resources.

Comment - Yes

It is important that any high-risk application receives sufficient resources to conduct an in-depth assessment of related risks and potential preventive or mitigation measures. This should include extensive stakeholder and rightsholder engagement.

Comment - I don't know

Consult the further resources listed, and consider whether the application in question is high-risk or not. In case of doubt, consider answering yes to the question since it is possible that the application should be considered high risk.

Comment - No

This means that the use of the digital component can be considered low-medium risk, unless it concerns a high-risk sector in a high-risk country context. In those scenarios, there is still need for extra caution.

  • See EU Commission, “White paper on AI”, page 17.

Is the digital project and/or component developed in a high-risk country context with regard to human rights?

Whether or not the country where the digital component is developed and used is of high-risk or not is important since a high-risk context often increases the potential risks for negative human rights impacts. In order to decide whether or not the country in question belongs to a high-risk category considering whether the following apply:
- no, or sub-par, data protection legislation
- poor rule of law, including inefficient court system
- conflict ridden country
- significant persecution of human rights defenders
- significant limits to civil and political rights
- unstable security situation
- possibility or history of censorship, intimidation, violence, etc. against vulnerable groups
- cybercrime is prevalent
- online harassment is common.

Consider also previous assessments conducted as part of the project design, including: Safeguards and Gender Management 1) Conflict and context sensitivity assessment,
and/or 2) Human Rights screening.

See further resources for more information.

Comment - Yes

Heightened attention will need to be paid to all kinds of data processing, AI applications etc., particularly with regard to groups that are vulnerable in the specific context. Any country context analysis performed during the project design phase should be updated with the specific digital product or service in mind.

Comment - I don't know

Consult the country context analysis developed during the project design stage of the project, and consider whether the country context is high-risk or not. In case of doubt, consider answering yes to the question since it is possible that the country should be considered high-risk.

Comment - No

That the country context is not considered high risk often means that rule of law is stronger, and that there are multiple safeguards in place on a national level.

Risk profile of project
Recommendation

Based on your answers to the risk questions, the digital component seems to involve low-to-medium risk. While that is positive, there is still need to be vigilant in case the context or application changes. Further sections around stakeholder engagement remain highly relevant even as potential risks are low.

Risk profile of project
Recommendation

Based on your answers on the risk questions, there is no high-risk application involved. However, both the country context and sector are high-risk which means that you will need to pay extra attention to the application and use of the digital component. Slight changes to the initial plan may pose significant risks.

Risk profile of project
Recommendation

Heightened attention will need to be paid to all kinds of data processing, AI applications etc., particularly with regard to groups that are vulnerable in the specific context. Any country context analysis performed during the project design phase should be updated with the specific digital product or service in mind.

Does the country where the project or digital component is being applied have adequate data protection legislation in place?

Since the application of many digital components depend on the possibility to collect, store, treat, alter and share data, and many also increase the possibilities to do just that, it is important to understand the regulatory context that the digital component will be applied in, in order to identify possible risks. If data protection regulation is in place and enforcement is efficient, that lowers the risk of data related activities.

See further resources for more information about data protection legislation in a variety of countries.

Comment - Yes

This lowers the risk-levels of data collection, storage and other forms of processing. However, if monitoring and/or enforcement is lacking, it may not mean much in practice and it will remain important to consider the human rights impacts of data related activities.

Recommendation - No

Due to the lack of data protection, the project should limit data related activities, particularly as it pertains to partners who may not have adequate data collection and processing standards and processes in place. Pay particular attention to collection of data without appropriate consent and collection of data that is not strictly necessary for the digital service or product to function, since there will likely be no efficient external oversight of the activities.

Recommendation - I don't know

Consult the further resources, and see whether you can identify the current status on data protection legislation in the country.

Have similar projects or components been developed/launched in the location/country previously?

In order to better be able to assess human rights impacts, it is beneficial to start by investigating the existence of other similar projects in the same geographical context, and then see what impacts they might have had. Please consider specifically whether the same specific digital components have been used or launched.

Comment - No

That means your project can potentially help others in the future. Considering being as transparent as possible to assist others developing similar activities.

Recommendation - I don't know

Assess whether similar projects have taken place before. That will help inform the identification of potential human rights impacts as well as preferred actions to avoid, prevent and address impacts.

Comment - Yes

Assess the outcomes of past projects and engage with the project owners as well as external stakeholders (including potentially impacted rightsholders). This will help you assess which preventive and mitigation measures should be taken in your project during its implementation.

Did the previous projects have negative impacts on human rights?

In order to respond to this question, it might be necessary to assess whether any reports have been published by the project itself, or whether there are news media or civil society reports about the project or digital component.

Recommendation - No

Assess similar past projects and consider what was put in place in terms of safeguards to avoid and prevent negative impacts on human rights. See if they can be replicated in your project.

Comment - I don't know

Reach out to those involved in the project or others that have knowledge of it, and see whether they are able to share more information about potential impacts (and their prevention or mitigation).

Comment - Yes

Consider which kind of impacts in the next question.

Which negative human rights impacts did the past projects have?

Potentially impacted human right and principles - Right to privacy

Right to privacy

Recommendation - Right to privacy

Take preventive measures to ensure that the digital project or component is not having the same negative impacts as past projects. Thoroughly assess the potential impacts on the right to privacy.

Potentially impacted human right and principles - Freedom from discrimination

Freedom from discrimination

Recommendation - Freedom from discrimination

Take preventive measures to ensure that the digital project or component is not having the same negative impacts as past projects. Thoroughly assess the potential impacts on the right to freedom from discrimination.

Potentially impacted human right and principles - Freedom of expression

Freedom of expression

Recommendation - Freedom of expression

Take preventive measures to ensure that the digital project or component is not having the same negative impacts as past projects. Thoroughly assess the potential impacts on the right to freedom of expression.

Recommendation - I don't know

Reach out to those involved in the past project or others that have knowledge of it, and see whether they are able to share more information about potential impacts (and their prevention or mitigation). Take preventive measures to ensure that the digital project or component is not having the same negative impacts.

Recommendation

Take preventive measures to ensure that the digital project or component is not having the same negative impacts as past projects.

Has a process to assess unintended negative consequences of the project taken place?

Assessing unintended negative consequences includes considering worst case scenarios of the implementation of the digital components, in order to be able to take early preventive and mitigation measures to avoid potential impacts. This necessarily includes considering impacts outside of the target group and intended users. Such an assessment should consider both the unintended consequences related to the intended use, but also the unintended use and application of the digital components themselves.

Comment - Yes

Discuss the potential unintended negative consequences with external stakeholders, including potentially impacted rightsholders. Consider the risk of those scenarios materializing.

Recommendation - No

Assess potential unintended negative consequences with the project team and other partners involved.

This could e.g.be in the form of a workshop where future scenarios and worst-case scenarios are discussed. Discuss your findings with external stakeholders, including potentially impacted rightsholders, while also leaving space for them to raise any other concerns of potential negative consequences of the project.

Do the intended users and/or other rightsholders belong to vulnerable or marginalized groups?

It is important that particular attention is paid to vulnerable and marginalised groups, since they are often at higher risks of being severely affected by adverse impacts of a project or digital component. It is therefore important to first of all identify who the vulnerable groups in the particular context are. Vulnerable groups may include children, women, religious or ethnic minorities, persons with disabilities, and migrants among others, but it is important to make an individual assessment of vulnerabilities based on the local realities.

Important to note, also, that vulnerability is not static. Instead, it always depend on the context. As such, vulnerability of individuals or groups refers to being “at a higher risk of being unable to anticipate, cope with, resist and recover from project-related risks and/or adverse impacts.”

Responding no to the question might be relevant, for example, if the project concerns a purely internal digitalisation project within a government agency, for it to improve certain administrative processes. If those processes concern decision-making that are important for individuals, however, the answer is instead a Yes.

Comment - No

In most scenarios this might imply that human rights risks are lower. However, make sure to consider potential discrimination risks related to vulnerable groups not being part of the intended users. Make sure to specifically consider whether those purposefully not engaging in the project belong to vulnerable groups.

Comment - Yes

Seeing as vulnerable groups may be impacted by the project, extra care must be taken to ensure that the vulnerable groups are not adversely impacted. Ensure that those groups and/or their legitimate representatives are consulted and engaged with in order to be able to assess any negative impacts particularly concerning the groups in question.

Recommendation - I don't know

Consult the further resources, and consider whether or not vulnerable or marginalized groups may be impacted by the project. Consider both direct users, but also those that might otherwise be impacted.

Comment - I don't know

Consider whether vulnerable groups may in fact be impacted.

Consider the following example: a country introduces an e-registration system for job-seekers. However, migrant workers tend to not register. While the migrant workers are not as such users of the service, they are still potentially impacted by the move to an e-registration system.

Which of the following groups may be impacted? (write your comment in the grey box)

The list is not exhaustive and there may, depending on the context, be other vulnerable groups that have been identified as potentially impacted by the project. If so, please select the "other" option and write down the vulnerable group you have identified.

Recommendation - Children and young persons

Conduct rightsholder engagement, and consider the following:
● Conduct consultation with children in coordination with child participation experts to facilitate participation respecting ethical standards
● Design the process so it is accessible, inclusive and meaningful for children
● Ensure voluntary participation in child-friendly environment
● Ensure that engagement
● Conduct consultations both with and about children and young people
● Consider engagement with parents and caregivers, teachers, community leaders, youth organisations and other with children’s best interests in mind

Recommendation - Women and girls

Conduct rightsholder engagement, and consider the following:
● Consult women separately in a gender-sensitive manner
● Include women HRIA team members
● Include HRIA team members with knowledge of the particular rights and experiences of women and girls, particularly in relation to digital projects, products and services
● Exclude male team members from certain interviews
● Provide safe and comfortable space for interviews
● Include particularly vulnerable sub-groups (e.g. female human rights defenders, young girls, etc.)
● Consider proactive and innovative approaches to lower the barrier for women to engage (e.g. providing childcare during meetings)

Recommendation - Indigenous peoples

Conduct rightsholder engagement, and consider the following:
● Include HRIA team members with knowledge of indigenous peoples’ rights and local context
● Respect indigenous representative institutions, be sure to understand the cultural and organisational characteristics of indigenous peoples and hierarchy of authorities in order to engage with the right people in the right order and manner
● Use appropriate language for the context
● For projects targeting or otherwise impacting indigenous peoples, ensure that para and per-indigenous methodologies are the basis for their development, when possible
● There is a risk of imposing unwanted processes or structures upon indigenous recipients

Recommendation - Workers and trade unions

Conduct rightsholder engagement, and consider the following:
● Make sure to meet different categories of workers and trade union leaders (e.g. by gender, position, unionised vs. non-unionised, etc.)
● Include ‘informal workers’ in HRIA
● Fix a time that suits their work schedule
● Consider interviewing workers outside of company premises and outside working hours

Recommendation - Minorities (national, racial, ethnic, religious or political)

Conduct rightsholder engagement, and consider the following:
● Minorities may speak another language than the national language; engagement with minority groups should be conducted in a language they understand and feel most comfortable communicating in
● Engagement should be culturally appropriate
● Given the different characteristics of specific minority groups, it can be useful to include an anthropologist in the team who has expertise in engaging with the minority group in question
● Ensure wide participation from within the minority community during engagement rather than only dealing with select community leaders who may not represent the community as a whole

Recommendation - Persons with disabilities

Conduct rightsholder engagement, and consider the following:
● When engaging with persons with particular physical or psychological disabilities, ensure that the location for meetings and/or the way of engaging is accessible and measures are taken to make engagement meaningful (e.g. ensuring sign language interpretation, information available in braille)

Recommendation - Older persons

Conduct rightsholder engagement, and consider the following:
● When engaging with older persons, ensure that the location for the meetings and mode of engaging is accessible, bearing in mind the greater likelihood of particular needs (e.g. wheelchair-friendly access and simple and user-friendly digital solutions)

Recommendation - Migrants, refugees, stateless and displaced person

Conduct rightsholder engagement, and consider the following:
● Due to their insecure legal status, individuals belonging to this rightsholder group, especially those without a residence permit, may be hesitant to speak openly, fearing that they may face repercussions; it is important to provide a safe space when engaging with migrants, refugees, stateless and/or displaced persons
● While for engagement with rightsholders is in general imperative to keep identities of interviewees confidential, for this group confidentiality requires extra special attention
● Consider remote or virtual engagement via encrypted communication channels to protect their safety

Recommendation - Lesbian, gay, bisexual, transgender, intersex (LGBTI) individuals

Conduct rightsholder engagement, and consider the following:
● Assessors should be appropriately trained on LGBTI issues when engaging with them
● Ensure that LGBTI people feel comfortable to provide information by ensuring that the collected data remains confidential
● Consider the possibility of anonymised forms of engagement
● When designing engagement plans ensure that the communities concerned are represented in their full diversity.

See Stakeholder Engagement section of Danish Institute for Human Rights, “Guidance on Human Rights Impact Assessment of Digital Activities” (forthcoming 2020).

Are the intended users or beneficiaries of the digital project or component (tool, service, product, etc) individual persons?

The digital component can be for the benefit individuals or it can be targeted at e.g. an organisation. An example of the former is for example a digital education platform or an e-registration system for migrant workers, with which the workers themselves interact. An example of the latter is an AI model that helps with the effectiveness of administrative processes and which no external individual interacts with.

If the digital product or service is meant for individuals there is increased need to focus on their ability to access and use the product or service. Consider therefore whether it is meant for an institution or for individual persons.

Comment - Yes

If the digital tool, service or product is meant for individual persons, it will be important to make sure it is accessible.

Comment - No

In most scenarios this might imply that human rights risks are lower. However, make sure to consider potential discrimination risks related to accessibility nonetheless since institutions also have individual users.

Comment - I don't know

If it concerns e.g. online classrooms, track and tracing apps, chatbots in public service, tele-medicine platforms, digital communications platforms, there are likely to be individual persons as users or beneficiaries.

Is the product or service accessible, particularly to vulnerable groups?

As long as the digital component will have rightsholders interacting with it, It will be important to consider whether it is developed to take into consideration the accessibility or the component itself. This can include considerations around: costs, language barriers, literacy levels among users, digital capacity, discrimination, and more.

Further questions to ask:
- Is the necessary physical infrastructure in place (e.g. broadband access)?
- Is the connectivity sufficiently stable?
- Is it affordable to most people or only to some (incl. cost of hardware as well as data tariffs?
- Is everyone (of the intended user group) aware of the product or service, so that they can use it?
- Do the intended users have the ability to use the product or service?
- Are there additional social or cultural barriers restricting access for certain societal groups?

See further resources for more information about accessibility, including specifically, AAAQ criteria: Available; Affordable, Acceptable; Accessible; Quality

Comment - Yes, and it has particularly been assessed.

Consider adopting a monitoring process to ensure its accessibility over time.

Potentially impacted human right and principles - No

Right to equality and freedom from discrimination

Recommendation - No

Work together with vulnerable groups and/or their representatives to ensure that the tool. product or service is accessible, in particular to vulnerable groups.

Potentially impacted human right and principles - I don't know

Right to equality and freedom from discrimination

Recommendation - I don't know

Engage with potentially vulnerable groups that might not find the digital tool, product or service accessible and hear their views, to better understand the overall accessibility.

Is the accessibility of the digital solution monitored/is there a plan for monitoring?

Comment - Yes

Accessibility related to digital products and services should be ensured throughout the life of the product or service. Ensure that you engage with intended users at regular intervals to ensure that it remains accessible.

Potentially impacted human right and principles - No

Right to equality and freedom from discrimination

Recommendation - No

Work together with users, particularly from vulnerable groups, and/or their representatives to develop a monitoring plan in order to ensure that the tool, product or service remains accessible and that any issues with accessibility are addressed as quickly as possible.

Potentially impacted human right and principles - I don't know

Right to equality and freedom from discrimination

Recommendation - I don't know

Consult with project partners and others responsible for the maintenance of the digital product or service in order to find out what the plan is for ensuring accessibility throughout the life of the product or service.

Have you engaged with stakeholders specifically on the potential impacts of the digital projects and/or components?

Stakeholders can both be internal (various project staff and functions) or external. External stakeholders include government actors and project partners involved in the development or use of the digital component, as well as civil society organisations, academic institutions and rightsholder groups. Engagement can take many forms, such as: focus groups, in-person or virtual interviews, public hearings.

Potentially impacted human right and principles - Yes, with internal stakeholders.

Right to an effective remedy and right to meaningful participation

Recommendation - Yes, with internal stakeholders.

Engage with external stakeholders as soon as the initial internal analysis of potential negative human rights impacts has been made. Focus specifically on vulnerable groups previously identified.

Comment - Yes, with internal stakeholders.

Engaging with internal stakeholders is important in order for everyone to have a common understanding of the issues.

Potentially impacted human right and principles - No

Right to an effective remedy and right to meaningful participation

Recommendation - No

Engage with both internal and external stakeholders on the topic of potential negative human rights impacts. Focus specifically on vulnerable groups previously identified.

Comment - No

Engaging with internal stakeholders on the topic of potential unintended negative human rights impacts is important in order to build internal capacity and ownership of the management of risks. Engaging with external stakeholders is important to validate your findings and analysis with the stakeholders that might have further insights to potential impacts, including the rights holders that might be impacted.

Recommendation - I don't know

Consult with project partners and others involved in the development of the digital component and see whether there has been any engagement with internal and external stakeholders on potential negative human rights impacts.

Have you specifically engaged with rights holders, including non-users, and/or their legitimate representatives?

Intended users include individuals who are the primary target group for the digital component. This will largely depend on the type of digital component, but may for example include those who will register using a new e-registration system.

In order to assess, for example, issues around accessibility or a lack of trust in the service itself (e.g. because of doubts of around data protection) it will also be important to engage with those not using the component. This can for example include individuals who could have used a new e-registration system but actively decided against it.

If the intended users are staff at a public unemployment service, that are helped in their decision-making by an AI model, those seeking support are not the users of the system, but are still rightsholders who may have their rights impacted, As such, they ought to be engaged.

In order to achieve meaningful stakeholder engagement, it is important to not only engage with governments and state agencies and relevant experts, but also to engage directly with those who are at risk of having their human rights impacts or their representatives, when direct engagement is not possible or appropriate.

Potentially impacted human right and principles - Yes, with intended users.

Right to an effective remedy and right to meaningful participation

Recommendation - Yes, with intended users.

Develop a plan to engage with potentially impacted ‘non-users’ of the product or service.

Comment - Yes, with intended users.

It is important that potentially impacted ‘non-users’ are also engaged during stakeholder engagement. Otherwise there is a risk that you are not aware of impacts related to e.g. those who might be impacted by the fact that they are not using the digital service or product (e.g. there might be issues with accessibility)

Comment - Yes, with intended users and other rights holders

That means you have considered one significant aspect of stakeholder engagement, namely getting to hear the perspectives and thoughts directly from potentially impacted rights holders. The important aspect is to ensure that engagement has been meaningful.

Potentially impacted human right and principles - No

Right to an effective remedy and right to meaningful participation

Recommendation - No

Develop a plan to engage with rights holders, including non-users and/or their legitimate representatives.

Comment - No

It is important that rightsholders (users and others) are specifically engaged during stakeholder engagement. Otherwise there is a risk that you miss significant impacts that other external stakeholders (who are not rightsholders) are not aware of.

Potentially impacted human right and principles - I don't know

Right to an effective remedy and right to meaningful participation

Recommendation - I don't know

Consult with project partners and others involved in the development of the digital component and see whether engagement with rights holders has taken place.

Have they provided input on the potential impacts of the project?

This will be the case when the engagement has not only concerned information sharing, but where the project has been open to input from external stakeholders on digital component and its potential impacts.

Comment - Yes

This is an important aspect of ensuring meaningful stakeholder engagement with regard to respecting human rights.

Potentially impacted human right and principles - No

Right to an effective remedy and right to meaningful participation

Recommendation - No

Develop a plan for engaging with rights holders, focusing on obtaining their input on human rights risks and impacts.

Comment - No

It is important that any engagement with stakeholders, in general, and rightsholders, in particular, is not one-way communication. Rather, it should be possible for rightsholders or their legitimate representatives to input on the internal analysis as well as add their own perspective to topics that might not have been covered in that analysis.

Recommendation - I don't know

Consult with project partners and others involved in the development of the digital component and see whether rights holders have had a chance to provide their own input.

Have the issues raised been addressed?

Consider what concerns were raised and assess whether any measures have been taken to prevent or mitigate those impacts.

Comment - Yes

That means you have considered one significant aspect of stakeholder engagement, namely to ensure that the engagement is meaningful and that it impacts the project implementation process as necessary. It is also important that you report back to the engaged stakeholders on what measures have been taken.

Recommendation - No, but it is underway.

Report back to rights holders previously engaged on the progress of addressing identified potential human rights issues, and provide a preliminary timeline.

Comment - No, but it is underway.

It is important that stakeholders, particularly vulnerable rightsholders, receive updates on the process so that they are able to assess whether the adequate adjustments have been made. If actions are delayed, you should still report back to stakeholders with preliminary timelines even if you are not able to report back on what exact actions will be taken.

Potentially impacted human right and principles - I don't know

Right to an effective remedy and right to meaningful participation

Recommendation - I don't know

Consult with project partners and others involved in the development and implementation of the digital component and see whether issues raised by rights holders have been addressed.

Potentially impacted human right and principles - No, there are no such plans.

Right to an effective remedy and right to meaningful participation

Recommendation - No, there are no such plans.

Review the consultation material to see whether there are in fact adjustments and accommodations to be made to ensure that human rights impacts are adequately prevented, mitigated or otherwise addressed.

Comment - No, there are no such plans.

In order to ensure that stakeholder engagement, particularly with vulnerable groups of rights holders, is meaningful it is essential that potential and actual negative human rights are addressed.

Have you or the project partner reported publicly on the potential impacts, mitigation measures, stakeholder engagement and other processes related to the questions in this tool?

This can include specific reports on the digital component in question, but also larger reports that also include information about the digital component, the potential impacts identified and other related activities. It is important to provide information that is relevant to external stakeholders, which is why it is important to cover all of the topics mentioned in the reporting.

Comment - Yes, on all of the topics.

It remains important to continue to update public communication as the project implementation and roll-out of the digital component progresses. A plan for further reporting and transparency should be developed, including how the information should reach the intended audience, which should include potentially impacted rightsholders. Plan communication to rightsholders so that the information is accessible to the various groups impacted by the project or component.

Comment - Not yet. It is underway.

It is important that stakeholders, particularly vulnerable rightsholders, receive information about the project implementation so that they are able to assess whether they agree with the impact analysis and whether appropriate actions have been taken.

Comment - Yes, on some of the mentioned topics.

It is positive that some reporting has taken place in order to ensure greater transparency, which improves accountability in relation to the project in general, and the digital component, in particular. However, it is important that everything from identified impacts to the effectiveness of mitigation measures is reported in order to increase the accountability of projects.

Potentially impacted human right and principles - No, there are no such plans.

Right to meaningful participation and right to access to information

Recommendation - No, there are no such plans.

Work with your partners and develop a transparency and communication plan around the impacts identified, engagement with stakeholders and planned preventive and/or mitigating actions.

Comment - No, there are no such plans.

Transparency is an important aspect of a rights-based approach to human rights impact assessments.

Recommendation - I don't know

Consult with project partners and others involved in the development and implementation of the digital component and see whether any public reporting has occurred.

What has not been reported on?

Recommendation - Mitigation measures

Draw up a plan on how to increase the transparency efforts in relation to mitigation measures.

Recommendation - Potential impacts

Draw up a plan on how to increase the transparency efforts in relation to the identified potential impacts.

Recommendation - Stakeholder engagement

Draw up a plan on how to increase the transparency efforts in relation to stakeholder engagement.

Is there a mechanism in place to capture feedback/complaints/grievances by users and non-users of the project or component(s)?

A grievance mechanism is a mechanism available for individuals who have concerns or complaints, and provides a way for them to submit those complaints to the entity managing the grievance mechanism. They can be constructed in many different ways, and the importance is not the design but the effectiveness (see further resources for more information on effectiveness of grievance mechanisms). Grievance mechanisms can be designed as telephone hotlines, basic email accounts, chat service, as well as physical mailboxes, among other things. Similar to previous questions around users and non-users, it is important that a wide range of rightsholders can access and use the grievance mechanism, so as to not bar them from submitting their concerns or complaints.

Grievance mechanisms are important for a variety of reasons. They can assist in the identification of potential human rights risks and impacts, they can function as an early "warning mechanism", and they can also serve to provide access to remedy to those rightsholders who have had their human rights adversely impacted by the digital components in question.

Comment - Yes, for users and non-users.

It is an essential aspect of respecting human rights to have a mechanism in place that can address grievances. Review the effectiveness criteria from the UN Guiding Principles on Business and Human Rights to see whether the existing grievance mechanism can be improved (see further resources).

Potentially impacted human right and principles - Not yet. It is underway.

Right to an effective remedy and right to meaningful participation

Recommendation - Not yet. It is underway.

Structure a plan for when the grievance mechanism will be in place and ensure that all relevant rights holders are able to access the mechanism and that they are made aware of its existence once it is in place.

Potentially impacted human right and principles - Yes, for users.

Right to an effective remedy and right to meaningful participation;

Recommendation - Yes, for users.

Review the grievance mechanism and the communication around it, ensuring that potentially impacted non-users also can access it.

Comment - Yes, for users.

It is important that non-users are also able to raise their complaints. This can for example be the case when those who have not registered in an e-registration project are not heard, while it may be their concerns that are of most interest to ensure that potential human rights impacts are avoided or addressed.

Potentially impacted human right and principles - No, there are no such plans.

Right to an effective remedy and right to meaningful participation

Recommendation - No, there are no such plans.

Work with partners to develop a mechanism that is aligned with the effectiveness criteria outlined in the UN Guiding Principles on Business and Human Rights (see further resources).

Comment - No, there are no such plans.

It is an essential aspect of respecting human rights to have a mechanism in place that can address grievances.

Recommendation - I don't know

Consult with project partners and others involved in the development and implementation of the digital component and see whether any grievance mechanism exists, whether it is used, and by who.

Thanks for participating

This is your results page. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum.