{ "faithfulness": { "score": 0.9773, "hallucination_rate": 0.0227, "n_hallucinated": 1, "n_claims": 45, "n_supported": 43, "n_clean_supported": 43, "n_contradicted": 1, "n_not_found": 0, "n_uncertain": 1, "n_superseded": 0, "coverage": 1.0, "claims": [ { "claim": "\"Nine categories of AI practices are prohibited under the regulation.\",", "verdict": "uncertain", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "judgment_call", "evidence": [ { "memory_id": "fe66c1f0-47f4-4fe6-a499-42543fb70243", "content": "integration in other AI systems; (67) \u2018floating-point operation\u2019 means any mathematical operation or assignment involving floating-point numbers, which are a subset of the real numbers typically represented on computers by an integer of fixed precision scaled by an integer exponent of a fixed base; (68) \u2018downstream provider\u2019 means a provider of an AI system, including a general-purpose AI system, which integrates an AI model, regardless of whether the AI model is provided by themselves and vertically integrated or provided by another entity based on contractual relations. Article 4 AI literacy Providers and deployers of AI systems shall take measures to ensure, to their best extent, a sufficient level of AI literacy of their staff and other persons dealing with the operation and use of AI systems on their behalf, taking into account their technical knowledge, experience, education and training and the context the AI systems are to be used in, and considering the persons or groups of persons on whom the AI systems are to be used. CHAPTER II PROHIBITED AI PRACTICES Article 5 Prohibited AI practices 1. The following AI practices shall be prohibited: (a) the placing on the market, the putting into service or the use of an AI system that deploys subliminal techniques beyond a person\u2019s consciousness or purposefully manipulative or deceptive techniques, with the objective, or the", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "5bd880b0-f373-4fbc-a929-5edc40ff6b8c", "content": "CHAPTER I GENERAL PROVISIONS Article 1 Subject matter` 1. The purpose of this Regulation is to improve the functioning of the internal market and promote the uptake of human-centric and trustworthy artificial intelligence (AI), while ensuring a high level of protection of health, safety, fundamental rights enshrined in the Charter, including democracy, the rule of law and environmental protection, against the harmful effects of AI systems in the Union and supporting innovation. 2. This Regulation lays down: (a) harmonised rules for the placing on the market, the putting into service, and the use of AI systems in the Union; (b) prohibitions of certain AI practices; (c) specific requirements for high-risk AI systems and obligations for operators of such systems; (d) harmonised transparency rules for certain AI systems; (e) harmonised rules for the placing on the market of general-purpose AI models; (f) rules on market monitoring, market surveillance, governance and enforcement; (g) measures to support innovation, with a particular focus on SMEs, including start-ups. Article 2 Scope 1. This Regulation applies to: (a) providers placing on the market or putting into service AI systems or placing on the market general-purpose AI models in the Union, irrespective of whether those providers are established or located within the Union or in a third country; (b) deployers of AI systems", "relevance_score": 0.5, "authority_status": null, "superseded": false }, { "memory_id": "f9cbbebb-83fa-4525-8135-a048aefb27c3", "content": "detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity; (d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity; (e) the placing on the market, the putting into service for this specific purpose, or the use of AI systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage; (f) the placing on the market, the putting into service for this specific purpose, or the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons; (g) the placing on the market, the putting into service for this specific", "relevance_score": 0.3333, "authority_status": null, "superseded": false } ], "note": "reviewed against the complete text of the controlling instrument and still not confirmable either way \u2014 likely a judgment call or an overstated claim; flagged for human review" }, { "claim": "\"Subliminal and manipulative techniques that materially distort behavior and cause significant harm by impairing informed decision-making are prohibited.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "fe66c1f0-47f4-4fe6-a499-42543fb70243", "content": "integration in other AI systems; (67) \u2018floating-point operation\u2019 means any mathematical operation or assignment involving floating-point numbers, which are a subset of the real numbers typically represented on computers by an integer of fixed precision scaled by an integer exponent of a fixed base; (68) \u2018downstream provider\u2019 means a provider of an AI system, including a general-purpose AI system, which integrates an AI model, regardless of whether the AI model is provided by themselves and vertically integrated or provided by another entity based on contractual relations. Article 4 AI literacy Providers and deployers of AI systems shall take measures to ensure, to their best extent, a sufficient level of AI literacy of their staff and other persons dealing with the operation and use of AI systems on their behalf, taking into account their technical knowledge, experience, education and training and the context the AI systems are to be used in, and considering the persons or groups of persons on whom the AI systems are to be used. CHAPTER II PROHIBITED AI PRACTICES Article 5 Prohibited AI practices 1. The following AI practices shall be prohibited: (a) the placing on the market, the putting into service or the use of an AI system that deploys subliminal techniques beyond a person\u2019s consciousness or purposefully manipulative or deceptive techniques, with the objective, or the", "relevance_score": 0.5, "authority_status": null, "superseded": false }, { "memory_id": "c32910db-6efb-4ae9-bf73-f84b85fc8707", "content": "effect of materially distorting the behaviour of a person or a group of persons by appreciably impairing their ability to make an informed decision, thereby causing them to take a decision that they would not have otherwise taken in a manner that causes or is reasonably likely to cause that person, another person or group of persons significant harm; (b) the placing on the market, the putting into service or the use of an AI system that exploits any of the vulnerabilities of a natural person or a specific group of persons due to their age, disability or a specific social or economic situation, with the objective, or the effect, of materially distorting the behaviour of that person or a person belonging to that group in a manner that causes or is reasonably likely to cause that person or another person significant harm; (c) the placing on the market, the putting into service or the use of AI systems for the evaluation or classification of natural persons or groups of persons over a certain period of time based on their social behaviour or known, inferred or predicted personal or personality characteristics, with the social score leading to either or both of the following: (i) detrimental or unfavourable treatment of certain natural persons or groups of persons in social contexts that are unrelated to the contexts in which the data was originally generated or collected; (ii)", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exploitation of vulnerabilities targeting persons by age, disability, or social/economic situation, causing material behavioral distortion and significant harm, is prohibited.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "c32910db-6efb-4ae9-bf73-f84b85fc8707", "content": "effect of materially distorting the behaviour of a person or a group of persons by appreciably impairing their ability to make an informed decision, thereby causing them to take a decision that they would not have otherwise taken in a manner that causes or is reasonably likely to cause that person, another person or group of persons significant harm; (b) the placing on the market, the putting into service or the use of an AI system that exploits any of the vulnerabilities of a natural person or a specific group of persons due to their age, disability or a specific social or economic situation, with the objective, or the effect, of materially distorting the behaviour of that person or a person belonging to that group in a manner that causes or is reasonably likely to cause that person or another person significant harm; (c) the placing on the market, the putting into service or the use of AI systems for the evaluation or classification of natural persons or groups of persons over a certain period of time based on their social behaviour or known, inferred or predicted personal or personality characteristics, with the social score leading to either or both of the following: (i) detrimental or unfavourable treatment of certain natural persons or groups of persons in social contexts that are unrelated to the contexts in which the data was originally generated or collected; (ii)", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Social scoring systems that evaluate natural persons based on social behavior or inferred characteristics, leading to detrimental treatment in unrelated contexts or disproportionate treatment, are prohibited.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "c32910db-6efb-4ae9-bf73-f84b85fc8707", "content": "effect of materially distorting the behaviour of a person or a group of persons by appreciably impairing their ability to make an informed decision, thereby causing them to take a decision that they would not have otherwise taken in a manner that causes or is reasonably likely to cause that person, another person or group of persons significant harm; (b) the placing on the market, the putting into service or the use of an AI system that exploits any of the vulnerabilities of a natural person or a specific group of persons due to their age, disability or a specific social or economic situation, with the objective, or the effect, of materially distorting the behaviour of that person or a person belonging to that group in a manner that causes or is reasonably likely to cause that person or another person significant harm; (c) the placing on the market, the putting into service or the use of AI systems for the evaluation or classification of natural persons or groups of persons over a certain period of time based on their social behaviour or known, inferred or predicted personal or personality characteristics, with the social score leading to either or both of the following: (i) detrimental or unfavourable treatment of certain natural persons or groups of persons in social contexts that are unrelated to the contexts in which the data was originally generated or collected; (ii)", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "f9cbbebb-83fa-4525-8135-a048aefb27c3", "content": "detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity; (d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity; (e) the placing on the market, the putting into service for this specific purpose, or the use of AI systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage; (f) the placing on the market, the putting into service for this specific purpose, or the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons; (g) the placing on the market, the putting into service for this specific", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Criminal risk assessment based solely on profiling or personality traits is prohibited, except systems supporting human assessment based on objective, verifiable facts.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "f9cbbebb-83fa-4525-8135-a048aefb27c3", "content": "detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity; (d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity; (e) the placing on the market, the putting into service for this specific purpose, or the use of AI systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage; (f) the placing on the market, the putting into service for this specific purpose, or the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons; (g) the placing on the market, the putting into service for this specific", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Facial recognition database creation through untargeted scraping from the internet or CCTV footage is prohibited.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "f9cbbebb-83fa-4525-8135-a048aefb27c3", "content": "detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity; (d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity; (e) the placing on the market, the putting into service for this specific purpose, or the use of AI systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage; (f) the placing on the market, the putting into service for this specific purpose, or the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons; (g) the placing on the market, the putting into service for this specific", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Emotion recognition in workplace and education is prohibited, except for medical or safety purposes.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "f9cbbebb-83fa-4525-8135-a048aefb27c3", "content": "detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity; (d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity; (e) the placing on the market, the putting into service for this specific purpose, or the use of AI systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage; (f) the placing on the market, the putting into service for this specific purpose, or the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons; (g) the placing on the market, the putting into service for this specific", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Biometric categorization systems deducing race, political opinions, trade union membership, religious beliefs, sex life, or sexual orientation are prohibited, except for lawful dataset labeling or law enforcement categorization.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "9b83b4c7-e03f-4eda-83c3-8621d1377549", "content": "purpose, or the use of biometric categorisation systems that categorise individually natural persons based on their biometric data to deduce or infer their race, political opinions, trade union membership, religious or philosophical beliefs, sex life or sexual orientation; this prohibition does not cover any labelling or filtering of lawfully acquired biometric datasets, such as images, based on biometric data or categorizing of biometric data in the area of law enforcement; (h) the use of \u2018real-time\u2019 remote biometric identification systems in publicly accessible spaces for the purposes of law enforcement, unless and in so far as such use is strictly necessary for one of the following objectives: (i) the targeted search for specific victims of abduction, trafficking in human beings or sexual exploitation of human beings, as well as the search for missing persons; (ii) the prevention of a specific, substantial and imminent threat to the life or physical safety of natural persons or a genuine and present or genuine and foreseeable threat of a terrorist attack; (iii) the localisation or identification of a person suspected of having committed a criminal offence, for the purpose of conducting a criminal investigation or prosecution or executing a criminal penalty for offences referred to in Annex II and punishable in the Member State concerned by a custodial sentence or a detention", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Real-time remote biometric identification in public spaces for law enforcement is prohibited, except for targeted victim searches, imminent threats to life/safety, or locating suspects for serious crimes with minimum 4-year custodial sentence.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": true, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "9b83b4c7-e03f-4eda-83c3-8621d1377549", "content": "purpose, or the use of biometric categorisation systems that categorise individually natural persons based on their biometric data to deduce or infer their race, political opinions, trade union membership, religious or philosophical beliefs, sex life or sexual orientation; this prohibition does not cover any labelling or filtering of lawfully acquired biometric datasets, such as images, based on biometric data or categorizing of biometric data in the area of law enforcement; (h) the use of \u2018real-time\u2019 remote biometric identification systems in publicly accessible spaces for the purposes of law enforcement, unless and in so far as such use is strictly necessary for one of the following objectives: (i) the targeted search for specific victims of abduction, trafficking in human beings or sexual exploitation of human beings, as well as the search for missing persons; (ii) the prevention of a specific, substantial and imminent threat to the life or physical safety of natural persons or a genuine and present or genuine and foreseeable threat of a terrorist attack; (iii) the localisation or identification of a person suspected of having committed a criminal offence, for the purpose of conducting a criminal investigation or prosecution or executing a criminal penalty for offences referred to in Annex II and punishable in the Member State concerned by a custodial sentence or a detention", "relevance_score": 0.0, "authority_status": null, "superseded": false }, { "memory_id": "08bee9f0-1e91-4bcd-b57a-8dedbdc6d16b", "content": "order for a maximum period of at least four years. Point (h) of the first subparagraph is without prejudice to Article 9 of Regulation (EU) 2016/679 for the processing of biometric data for purposes other than law enforcement. 2. The use of \u2018real-time\u2019 remote biometric identification systems in publicly accessible spaces for the purposes of law enforcement for any of the objectives referred to in paragraph 1, first subparagraph, point (h), shall be deployed for the purposes set out in that point only to confirm the identity of the specifically targeted individual, and it shall take into account the following elements: (a) the nature of the situation giving rise to the possible use, in particular the seriousness, probability and scale of the harm that would be caused if the system were not used; (b) the consequences of the use of the system for the rights and freedoms of all persons concerned, in particular the seriousness, probability and scale of those consequences. In addition, the use of \u2018real-time\u2019 remote biometric identification systems in publicly accessible spaces for the purposes of law enforcement for any of the objectives referred to in paragraph 1, first subparagraph, point (h), of this Article shall comply with necessary and proportionate safeguards and conditions in relation to the use in accordance with the national law authorising the use thereof, in particular", "relevance_score": 0.0, "authority_status": null, "superseded": false }, { "memory_id": "3567e4f9-af41-4094-8e3b-1c169e23244d", "content": "as regards the temporal, geographic and personal limitations. The use of the \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay. 3. For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of law enforcement of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and", "relevance_score": 0.0, "authority_status": null, "superseded": false } ], "note": "settled by full-source review: judged against the complete text of the controlling instrument (as amended)" }, { "claim": "\"Real-time biometric identification for law enforcement requires prior judicial or independent administrative authorization.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3567e4f9-af41-4094-8e3b-1c169e23244d", "content": "as regards the temporal, geographic and personal limitations. The use of the \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay. 3. For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of law enforcement of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "fdaf028e-279e-4e3f-88c0-97a70e566d5d", "content": "all the data, as well as the results and outputs of that use shall be immediately discarded and deleted. The competent judicial authority or an independent administrative authority whose decision is binding shall grant the authorisation only where it is satisfied, on the basis of objective evidence or clear indications presented to it, that the use of the \u2018real-time\u2019 remote biometric identification system concerned is necessary for, and proportionate to, achieving one of the objectives specified in paragraph 1, first subparagraph, point (h), as identified in the request and, in particular, remains limited to what is strictly necessary concerning the period of time as well as the geographic and personal scope. In deciding on the request, that authority shall take into account the elements referred to in paragraph 2. No decision that produces an adverse legal effect on a person may be taken based solely on the output of the \u2018real-time\u2019 remote biometric identification system. 4. Without prejudice to paragraph 3, each use of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces for law enforcement purposes shall be notified to the relevant market surveillance authority and the national data protection authority in accordance with the national rules referred to in paragraph 5. The notification shall, as a minimum, contain the information specified under", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Real-time biometric identification for law enforcement requires fundamental rights impact assessment.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3567e4f9-af41-4094-8e3b-1c169e23244d", "content": "as regards the temporal, geographic and personal limitations. The use of the \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay. 3. For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of law enforcement of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "f31127f1-ec56-4307-988d-5302b61454ae", "content": "by public law, or are private entities providing public services, and deployers of high-risk AI systems referred to in points 5 (b) and (c) of Annex III, shall perform an assessment of the impact on fundamental rights that the use of such system may produce. For that purpose, deployers shall perform an assessment consisting of: (a) a description of the deployer\u2019s processes in which the high-risk AI system will be used in line with its intended purpose; (b) a description of the period of time within which, and the frequency with which, each high-risk AI system is intended to be used; (c) the categories of natural persons and groups likely to be affected by its use in the specific context; (d) the specific risks of harm likely to have an impact on the categories of natural persons or groups of persons identified pursuant to point (c) of this paragraph, taking into account the information given by the provider pursuant to Article 13; (e) a description of the implementation of human oversight measures, according to the instructions for use; (f) the measures to be taken in the case of the materialisation of those risks, including the arrangements for internal governance and complaint mechanisms. 2. The obligation laid down in paragraph 1 applies to the first use of the high-risk AI system. The deployer may, in similar cases, rely on previously conducted fundamental rights impact", "relevance_score": 0.0833, "authority_status": null, "superseded": false } ] }, { "claim": "\"Real-time biometric identification for law enforcement requires EU database registration.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": true, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3567e4f9-af41-4094-8e3b-1c169e23244d", "content": "as regards the temporal, geographic and personal limitations. The use of the \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay. 3. For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of law enforcement of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Emergency use of real-time biometric identification for law enforcement is permitted with authorization within 24 hours.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3567e4f9-af41-4094-8e3b-1c169e23244d", "content": "as regards the temporal, geographic and personal limitations. The use of the \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay. 3. For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of law enforcement of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces shall be subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"No adverse legal decisions may be based solely on real-time biometric identification system output.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "fdaf028e-279e-4e3f-88c0-97a70e566d5d", "content": "all the data, as well as the results and outputs of that use shall be immediately discarded and deleted. The competent judicial authority or an independent administrative authority whose decision is binding shall grant the authorisation only where it is satisfied, on the basis of objective evidence or clear indications presented to it, that the use of the \u2018real-time\u2019 remote biometric identification system concerned is necessary for, and proportionate to, achieving one of the objectives specified in paragraph 1, first subparagraph, point (h), as identified in the request and, in particular, remains limited to what is strictly necessary concerning the period of time as well as the geographic and personal scope. In deciding on the request, that authority shall take into account the elements referred to in paragraph 2. No decision that produces an adverse legal effect on a person may be taken based solely on the output of the \u2018real-time\u2019 remote biometric identification system. 4. Without prejudice to paragraph 3, each use of a \u2018real-time\u2019 remote biometric identification system in publicly accessible spaces for law enforcement purposes shall be notified to the relevant market surveillance authority and the national data protection authority in accordance with the national rules referred to in paragraph 5. The notification shall, as a minimum, contain the information specified under", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"An AI system is classified as high-risk if it is a safety component of products covered by Union harmonization legislation listed in Annex I and requires third-party conformity assessment.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "0904e19a-891e-440b-871a-28a03a7a9f14", "content": "fulfilled: (a) the AI system is intended to be used as a safety component of a product, or the AI system is itself a product, covered by the Union harmonisation legislation listed in Annex I; (b) the product whose safety component pursuant to point (a) is the AI system, or the AI system itself as a product, is required to undergo a third-party conformity assessment, with a view to the placing on the market or the putting into service of that product pursuant to the Union harmonisation legislation listed in Annex I. 2. In addition to the high-risk AI systems referred to in paragraph 1, AI systems referred to in Annex III shall be considered to be high-risk. 3. By derogation from paragraph 2, an AI system referred to in Annex III shall not be considered to be high-risk where it does not pose a significant risk of harm to the health, safety or fundamental rights of natural persons, including by not materially influencing the outcome of decision making. The first subparagraph shall apply where any of the following conditions is fulfilled: (a) the AI system is intended to perform a narrow procedural task; (b) the AI system is intended to improve the result of a previously completed human activity; (c) the AI system is intended to detect decision-making patterns or deviations from prior decision-making patterns and is not meant to replace or influence the previously completed human", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"AI systems listed in Annex III are high-risk, except where they pose no significant risk of harm to health, safety, or fundamental rights and meet one of four conditions: performing narrow procedural tasks, improving prior human activity, detecting decision-making pattern deviations without replacing human assessment, or performing preparatory assessment tasks.\",", "verdict": "supported", "confidence": 0.98, "superseded": false, "recovered": true, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "0904e19a-891e-440b-871a-28a03a7a9f14", "content": "fulfilled: (a) the AI system is intended to be used as a safety component of a product, or the AI system is itself a product, covered by the Union harmonisation legislation listed in Annex I; (b) the product whose safety component pursuant to point (a) is the AI system, or the AI system itself as a product, is required to undergo a third-party conformity assessment, with a view to the placing on the market or the putting into service of that product pursuant to the Union harmonisation legislation listed in Annex I. 2. In addition to the high-risk AI systems referred to in paragraph 1, AI systems referred to in Annex III shall be considered to be high-risk. 3. By derogation from paragraph 2, an AI system referred to in Annex III shall not be considered to be high-risk where it does not pose a significant risk of harm to the health, safety or fundamental rights of natural persons, including by not materially influencing the outcome of decision making. The first subparagraph shall apply where any of the following conditions is fulfilled: (a) the AI system is intended to perform a narrow procedural task; (b) the AI system is intended to improve the result of a previously completed human activity; (c) the AI system is intended to detect decision-making patterns or deviations from prior decision-making patterns and is not meant to replace or influence the previously completed human", "relevance_score": 0.0, "authority_status": null, "superseded": false }, { "memory_id": "79a4ffc8-5d54-4d97-94d6-44e796e22a48", "content": "assessment, without proper human review; or (d) the AI system is intended to perform a preparatory task to an assessment relevant for the purposes of the use cases listed in Annex III. Notwithstanding the first subparagraph, an AI system referred to in Annex III shall always be considered to be high-risk where the AI system performs profiling of natural persons. 4. A provider who considers that an AI system referred to in Annex III is not high-risk shall document its assessment before that system is placed on the market or put into service. Such provider shall be subject to the registration obligation set out in Article 49(2). Upon request of national competent authorities, the provider shall provide the documentation of the assessment. 5. The Commission shall, after consulting the European Artificial Intelligence Board (the \u2018Board\u2019), and no later than 2 February 2026, provide guidelines specifying the practical implementation of this Article in line with Article 96 together with a comprehensive list of practical examples of use cases of AI systems that are high-risk and not high-risk. 6. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraph 3, second subparagraph, of this Article by adding new conditions to those laid down therein, or by modifying them, where there is concrete and reliable evidence of the existence of AI", "relevance_score": 0.0, "authority_status": null, "superseded": false } ], "note": "count claim: total re-verified by an enumerate-and-count review against the complete text of the controlling instrument" }, { "claim": "\"AI systems performing profiling of natural persons are always high-risk.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": true, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "79a4ffc8-5d54-4d97-94d6-44e796e22a48", "content": "assessment, without proper human review; or (d) the AI system is intended to perform a preparatory task to an assessment relevant for the purposes of the use cases listed in Annex III. Notwithstanding the first subparagraph, an AI system referred to in Annex III shall always be considered to be high-risk where the AI system performs profiling of natural persons. 4. A provider who considers that an AI system referred to in Annex III is not high-risk shall document its assessment before that system is placed on the market or put into service. Such provider shall be subject to the registration obligation set out in Article 49(2). Upon request of national competent authorities, the provider shall provide the documentation of the assessment. 5. The Commission shall, after consulting the European Artificial Intelligence Board (the \u2018Board\u2019), and no later than 2 February 2026, provide guidelines specifying the practical implementation of this Article in line with Article 96 together with a comprehensive list of practical examples of use cases of AI systems that are high-risk and not high-risk. 6. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraph 3, second subparagraph, of this Article by adding new conditions to those laid down therein, or by modifying them, where there is concrete and reliable evidence of the existence of AI", "relevance_score": 0.0, "authority_status": null, "superseded": false } ], "note": "settled by full-source review: judged against the complete text of the controlling instrument (as amended)" }, { "claim": "\"Providers must document assessments concluding systems are not high-risk and register them in the EU database.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "79a4ffc8-5d54-4d97-94d6-44e796e22a48", "content": "assessment, without proper human review; or (d) the AI system is intended to perform a preparatory task to an assessment relevant for the purposes of the use cases listed in Annex III. Notwithstanding the first subparagraph, an AI system referred to in Annex III shall always be considered to be high-risk where the AI system performs profiling of natural persons. 4. A provider who considers that an AI system referred to in Annex III is not high-risk shall document its assessment before that system is placed on the market or put into service. Such provider shall be subject to the registration obligation set out in Article 49(2). Upon request of national competent authorities, the provider shall provide the documentation of the assessment. 5. The Commission shall, after consulting the European Artificial Intelligence Board (the \u2018Board\u2019), and no later than 2 February 2026, provide guidelines specifying the practical implementation of this Article in line with Article 96 together with a comprehensive list of practical examples of use cases of AI systems that are high-risk and not high-risk. 6. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraph 3, second subparagraph, of this Article by adding new conditions to those laid down therein, or by modifying them, where there is concrete and reliable evidence of the existence of AI", "relevance_score": 0.25, "authority_status": null, "superseded": false }, { "memory_id": "b90ca780-b147-4d6c-b1ee-90cc5146adec", "content": "out in Article 43. The identification number of the notified body shall be affixed by the body itself or, under its instructions, by the provider or by the provider\u2019s authorised representative. The identification number shall also be indicated in any promotional material which mentions that the high-risk AI system fulfils the requirements for CE marking. 5. Where high-risk AI systems are subject to other Union law which also provides for the affixing of the CE marking, the CE marking shall indicate that the high-risk AI system also fulfil the requirements of that other law. Article 49 Registration 1. Before placing on the market or putting into service a high-risk AI system listed in Annex III, with the exception of high-risk AI systems referred to in point 2 of Annex III, the provider or, where applicable, the authorised representative shall register themselves and their system in the EU database referred to in Article 71. 2. Before placing on the market or putting into service an AI system for which the provider has concluded that it is not high-risk according to Article 6(3), that provider or, where applicable, the authorised representative shall register themselves and that system in the EU database referred to in Article 71. 3. Before putting into service or using a high-risk AI system listed in Annex III, with the exception of high-risk AI systems listed in point 2 of", "relevance_score": 0.1667, "authority_status": null, "superseded": false } ] }, { "claim": "\"The Commission shall provide implementation guidelines for high-risk AI system classification by 15 March 2027.\",", "verdict": "contradicted", "confidence": 0.95, "superseded": false, "recovered": true, "reason_code": "contradicts_current_source", "evidence": [ { "memory_id": "79a4ffc8-5d54-4d97-94d6-44e796e22a48", "content": "assessment, without proper human review; or (d) the AI system is intended to perform a preparatory task to an assessment relevant for the purposes of the use cases listed in Annex III. Notwithstanding the first subparagraph, an AI system referred to in Annex III shall always be considered to be high-risk where the AI system performs profiling of natural persons. 4. A provider who considers that an AI system referred to in Annex III is not high-risk shall document its assessment before that system is placed on the market or put into service. Such provider shall be subject to the registration obligation set out in Article 49(2). Upon request of national competent authorities, the provider shall provide the documentation of the assessment. 5. The Commission shall, after consulting the European Artificial Intelligence Board (the \u2018Board\u2019), and no later than 2 February 2026, provide guidelines specifying the practical implementation of this Article in line with Article 96 together with a comprehensive list of practical examples of use cases of AI systems that are high-risk and not high-risk. 6. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraph 3, second subparagraph, of this Article by adding new conditions to those laid down therein, or by modifying them, where there is concrete and reliable evidence of the existence of AI", "relevance_score": 0.0, "authority_status": null, "superseded": false } ], "note": "settled by full-source review: judged against the complete text of the controlling instrument (as amended)" }, { "claim": "\"Providers must establish, implement, document, and maintain a continuous iterative risk management system throughout the system's lifecycle.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a2d782e5-24f3-4339-a6de-133aeea34b51", "content": "and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I. Article 9 Risk management system 1. A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems. 2. The risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-risk AI system, requiring regular systematic review and updating. It shall comprise the following steps: (a) the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is used in accordance with its intended purpose; (b) the estimation and evaluation of the risks that may emerge when the high-risk AI system is used in accordance with its intended purpose, and under conditions of reasonably foreseeable misuse; (c) the evaluation of other risks possibly arising, based on the analysis of data gathered from the post-market monitoring system referred to in Article 72; (d) the adoption of appropriate and targeted risk management measures designed to address the risks identified pursuant to point (a). 3. The risks referred to", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Risk management system must comprise identification and analysis of known and reasonably foreseeable risks.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a2d782e5-24f3-4339-a6de-133aeea34b51", "content": "and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I. Article 9 Risk management system 1. A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems. 2. The risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-risk AI system, requiring regular systematic review and updating. It shall comprise the following steps: (a) the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is used in accordance with its intended purpose; (b) the estimation and evaluation of the risks that may emerge when the high-risk AI system is used in accordance with its intended purpose, and under conditions of reasonably foreseeable misuse; (c) the evaluation of other risks possibly arising, based on the analysis of data gathered from the post-market monitoring system referred to in Article 72; (d) the adoption of appropriate and targeted risk management measures designed to address the risks identified pursuant to point (a). 3. The risks referred to", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Risk management system must comprise estimation and evaluation of risks under intended use and reasonably foreseeable misuse.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a2d782e5-24f3-4339-a6de-133aeea34b51", "content": "and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I. Article 9 Risk management system 1. A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems. 2. The risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-risk AI system, requiring regular systematic review and updating. It shall comprise the following steps: (a) the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is used in accordance with its intended purpose; (b) the estimation and evaluation of the risks that may emerge when the high-risk AI system is used in accordance with its intended purpose, and under conditions of reasonably foreseeable misuse; (c) the evaluation of other risks possibly arising, based on the analysis of data gathered from the post-market monitoring system referred to in Article 72; (d) the adoption of appropriate and targeted risk management measures designed to address the risks identified pursuant to point (a). 3. The risks referred to", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Risk management system must comprise evaluation of risks from post-market monitoring data.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a2d782e5-24f3-4339-a6de-133aeea34b51", "content": "and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I. Article 9 Risk management system 1. A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems. 2. The risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-risk AI system, requiring regular systematic review and updating. It shall comprise the following steps: (a) the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is used in accordance with its intended purpose; (b) the estimation and evaluation of the risks that may emerge when the high-risk AI system is used in accordance with its intended purpose, and under conditions of reasonably foreseeable misuse; (c) the evaluation of other risks possibly arising, based on the analysis of data gathered from the post-market monitoring system referred to in Article 72; (d) the adoption of appropriate and targeted risk management measures designed to address the risks identified pursuant to point (a). 3. The risks referred to", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Risk management system must comprise adoption of appropriate, targeted risk management measures.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a2d782e5-24f3-4339-a6de-133aeea34b51", "content": "and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I. Article 9 Risk management system 1. A risk management system shall be established, implemented, documented and maintained in relation to high-risk AI systems. 2. The risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-risk AI system, requiring regular systematic review and updating. It shall comprise the following steps: (a) the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is used in accordance with its intended purpose; (b) the estimation and evaluation of the risks that may emerge when the high-risk AI system is used in accordance with its intended purpose, and under conditions of reasonably foreseeable misuse; (c) the evaluation of other risks possibly arising, based on the analysis of data gathered from the post-market monitoring system referred to in Article 72; (d) the adoption of appropriate and targeted risk management measures designed to address the risks identified pursuant to point (a). 3. The risks referred to", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "896792ef-379b-477f-92b4-f39644ec2e57", "content": "in this Article shall concern only those which may be reasonably mitigated or eliminated through the development or design of the high-risk AI system, or the provision of adequate technical information. 4. The risk management measures referred to in paragraph 2, point (d), shall give due consideration to the effects and possible interaction resulting from the combined application of the requirements set out in this Section, with a view to minimising risks more effectively while achieving an appropriate balance in implementing the measures to fulfil those requirements. 5. The risk management measures referred to in paragraph 2, point (d), shall be such that the relevant residual risk associated with each hazard, as well as the overall residual risk of the high-risk AI systems is judged to be acceptable. In identifying the most appropriate risk management measures, the following shall be ensured: (a) elimination or reduction of risks identified and evaluated pursuant to paragraph 2 in as far as technically feasible through adequate design and development of the high-risk AI system; (b) where appropriate, implementation of adequate mitigation and control measures addressing risks that cannot be eliminated; (c) provision of information required pursuant to Article 13 and, where appropriate, training to deployers. With a view to eliminating or reducing risks related to the use of", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Testing must ensure consistent performance for intended purpose and compliance with requirements.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "e674a517-b11c-4ad7-a013-637b330a9a2e", "content": "the high-risk AI system, due consideration shall be given to the technical knowledge, experience, education, the training to be expected by the deployer, and the presumable context in which the system is intended to be used. 6. High-risk AI systems shall be tested for the purpose of identifying the most appropriate and targeted risk management measures. Testing shall ensure that high-risk AI systems perform consistently for their intended purpose and that they are in compliance with the requirements set out in this Section. 7. Testing procedures may include testing in real-world conditions in accordance with Article 60. 8. The testing of high-risk AI systems shall be performed, as appropriate, at any time throughout the development process, and, in any event, prior to their being placed on the market or put into service. Testing shall be carried out against prior defined metrics and probabilistic thresholds that are appropriate to the intended purpose of the high-risk AI system. 9. When implementing the risk management system as provided for in paragraphs 1 to 7, providers shall give consideration to whether in view of its intended purpose the high-risk AI system is likely to have an adverse impact on persons under the age of 18 and, as appropriate, other vulnerable groups. 10. For providers of high-risk AI systems that are subject to requirements regarding internal risk", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Testing may include real-world conditions and must occur prior to market placement against predefined metrics and probabilistic thresholds.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "a1bfea76-3108-4818-b175-c24b10fd21f5", "content": "methodology and requirements for the activities carried out within the sandbox; (55) \u2018AI regulatory sandbox\u2019 means a controlled framework set up by a competent authority which offers providers or prospective providers of AI systems the possibility to develop, train, validate and test, where appropriate in real-world conditions, an innovative AI system, pursuant to a sandbox plan for a limited time under regulatory supervision; (56) \u2018AI literacy\u2019 means skills, knowledge and understanding that allow providers, deployers and affected persons, taking into account their respective rights and obligations in the context of this Regulation, to make an informed deployment of AI systems, as well as to gain awareness about the opportunities and risks of AI and possible harm it can cause; (57) \u2018testing in real-world conditions\u2019 means the temporary testing of an AI system for its intended purpose in real-world conditions outside a laboratory or otherwise simulated environment, with a view to gathering reliable and robust data and to assessing and verifying the conformity of the AI system with the requirements of this Regulation and it does not qualify as placing the AI system on the market or putting it into service within the meaning of this Regulation, provided that all the conditions laid down in Article 57 or 60 are fulfilled; (58) \u2018subject\u2019, for the purpose of real-world testing, means", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "e674a517-b11c-4ad7-a013-637b330a9a2e", "content": "the high-risk AI system, due consideration shall be given to the technical knowledge, experience, education, the training to be expected by the deployer, and the presumable context in which the system is intended to be used. 6. High-risk AI systems shall be tested for the purpose of identifying the most appropriate and targeted risk management measures. Testing shall ensure that high-risk AI systems perform consistently for their intended purpose and that they are in compliance with the requirements set out in this Section. 7. Testing procedures may include testing in real-world conditions in accordance with Article 60. 8. The testing of high-risk AI systems shall be performed, as appropriate, at any time throughout the development process, and, in any event, prior to their being placed on the market or put into service. Testing shall be carried out against prior defined metrics and probabilistic thresholds that are appropriate to the intended purpose of the high-risk AI system. 9. When implementing the risk management system as provided for in paragraphs 1 to 7, providers shall give consideration to whether in view of its intended purpose the high-risk AI system is likely to have an adverse impact on persons under the age of 18 and, as appropriate, other vulnerable groups. 10. For providers of high-risk AI systems that are subject to requirements regarding internal risk", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"High-risk AI systems using training techniques must be developed on training, validation, and testing datasets meeting quality criteria.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "61f91443-b8be-473b-bf43-3d65d2e7951d", "content": "management processes under other relevant provisions of Union law, the aspects provided in paragraphs 1 to 9 may be part of, or combined with, the risk management procedures established pursuant to that law. Article 10 Data and data governance 1. High-risk AI systems which make use of techniques involving the training of AI models with data shall be developed on the basis of training, validation and testing data sets that meet the quality criteria referred to in paragraphs 2 to 5 whenever such data sets are used. 2. Training, validation and testing data sets shall be subject to data governance and management practices appropriate for the intended purpose of the high-risk AI system. Those practices shall concern in particular: (a) the relevant design choices; (b) data collection processes and the origin of data, and in the case of personal data, the original purpose of the data collection; (c) relevant data-preparation processing operations, such as annotation, labelling, cleaning, updating, enrichment and aggregation; (d) the formulation of assumptions, in particular with respect to the information that the data are supposed to measure and represent; (e) an assessment of the availability, quantity and suitability of the data sets that are needed; (f) examination in view of possible biases that are likely to affect the health and safety of persons, have a negative impact on", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "ee1747ad-5a50-4956-9aaa-541424d6743b", "content": "fundamental rights or lead to discrimination prohibited under Union law, especially where data outputs influence inputs for future operations; (g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f); (h) the identification of relevant data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can be addressed. 3. Training, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the intended purpose. They shall have the appropriate statistical properties, including, where applicable, as regards the persons or groups of persons in relation to whom the high-risk AI system is intended to be used. Those characteristics of the data sets may be met at the level of individual data sets or at the level of a combination thereof. 4. Data sets shall take into account, to the extent required by the intended purpose, the characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting within which the high-risk AI system is intended to be used. 5. To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-risk AI systems in accordance with paragraph (2), points (f) and (g)", "relevance_score": 0.2, "authority_status": null, "superseded": false } ] }, { "claim": "\"Data governance practices must address design choices, data collection processes, data preparation operations, assumptions, dataset availability assessment, bias examination, bias mitigation measures, and identification of data gaps.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "61f91443-b8be-473b-bf43-3d65d2e7951d", "content": "management processes under other relevant provisions of Union law, the aspects provided in paragraphs 1 to 9 may be part of, or combined with, the risk management procedures established pursuant to that law. Article 10 Data and data governance 1. High-risk AI systems which make use of techniques involving the training of AI models with data shall be developed on the basis of training, validation and testing data sets that meet the quality criteria referred to in paragraphs 2 to 5 whenever such data sets are used. 2. Training, validation and testing data sets shall be subject to data governance and management practices appropriate for the intended purpose of the high-risk AI system. Those practices shall concern in particular: (a) the relevant design choices; (b) data collection processes and the origin of data, and in the case of personal data, the original purpose of the data collection; (c) relevant data-preparation processing operations, such as annotation, labelling, cleaning, updating, enrichment and aggregation; (d) the formulation of assumptions, in particular with respect to the information that the data are supposed to measure and represent; (e) an assessment of the availability, quantity and suitability of the data sets that are needed; (f) examination in view of possible biases that are likely to affect the health and safety of persons, have a negative impact on", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "ee1747ad-5a50-4956-9aaa-541424d6743b", "content": "fundamental rights or lead to discrimination prohibited under Union law, especially where data outputs influence inputs for future operations; (g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f); (h) the identification of relevant data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can be addressed. 3. Training, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the intended purpose. They shall have the appropriate statistical properties, including, where applicable, as regards the persons or groups of persons in relation to whom the high-risk AI system is intended to be used. Those characteristics of the data sets may be met at the level of individual data sets or at the level of a combination thereof. 4. Data sets shall take into account, to the extent required by the intended purpose, the characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting within which the high-risk AI system is intended to be used. 5. To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-risk AI systems in accordance with paragraph (2), points (f) and (g)", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Datasets must be relevant, sufficiently representative, free of errors, and complete for intended purpose, with appropriate statistical properties.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "ee1747ad-5a50-4956-9aaa-541424d6743b", "content": "fundamental rights or lead to discrimination prohibited under Union law, especially where data outputs influence inputs for future operations; (g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f); (h) the identification of relevant data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can be addressed. 3. Training, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the intended purpose. They shall have the appropriate statistical properties, including, where applicable, as regards the persons or groups of persons in relation to whom the high-risk AI system is intended to be used. Those characteristics of the data sets may be met at the level of individual data sets or at the level of a combination thereof. 4. Data sets shall take into account, to the extent required by the intended purpose, the characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting within which the high-risk AI system is intended to be used. 5. To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-risk AI systems in accordance with paragraph (2), points (f) and (g)", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Data must account for geographical, contextual, behavioral, or functional characteristics of the specific setting.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "ee1747ad-5a50-4956-9aaa-541424d6743b", "content": "fundamental rights or lead to discrimination prohibited under Union law, especially where data outputs influence inputs for future operations; (g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f); (h) the identification of relevant data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can be addressed. 3. Training, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the intended purpose. They shall have the appropriate statistical properties, including, where applicable, as regards the persons or groups of persons in relation to whom the high-risk AI system is intended to be used. Those characteristics of the data sets may be met at the level of individual data sets or at the level of a combination thereof. 4. Data sets shall take into account, to the extent required by the intended purpose, the characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting within which the high-risk AI system is intended to be used. 5. To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-risk AI systems in accordance with paragraph (2), points (f) and (g)", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Providers may exceptionally process special categories of personal data for bias detection and correction only where bias detection cannot be effectively fulfilled by other data.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exceptional processing of special categories of personal data for bias detection requires technical limitations on data re-use.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exceptional processing of special categories of personal data for bias detection requires state-of-the-art security and privacy-preserving measures including pseudonymization.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exceptional processing of special categories of personal data for bias detection requires strict controls and documentation of access.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exceptional processing of special categories of personal data for bias detection requires data is not transmitted to other parties.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Exceptional processing of special categories of personal data for bias detection requires data is deleted once bias is corrected or retention period ends.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "74296203-4e26-4476-8f1c-8acdbc2e4c7e", "content": "of this Article, the providers of such systems may exceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-the-art security and privacy-preserving measures, including pseudonymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protected, subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those personal data with appropriate confidentiality obligations; (d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties; (e) the special categories of personal data are deleted once the bias has been corrected or the personal data has reached the end of its retention period, whichever comes", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Technical documentation must be drawn up before market placement and kept up-to-date.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3f7f76f1-1685-4ead-b5ab-4ef752b354ae", "content": "first; (f) the records of processing activities pursuant to Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680 include the reasons why the processing of special categories of personal data was strictly necessary to detect and correct biases, and why that objective could not be achieved by processing other data. 6. For the development of high-risk AI systems not using techniques involving the training of AI models, paragraphs 2 to 5 apply only to the testing data sets. Article 11 Technical documentation 1. The technical documentation of a high-risk AI system shall be drawn up before that system is placed on the market or put into service and shall be kept up-to date. The technical documentation shall be drawn up in such a way as to demonstrate that the high-risk AI system complies with the requirements set out in this Section and to provide national competent authorities and notified bodies with the necessary information in a clear and comprehensive form to assess the compliance of the AI system with those requirements. It shall contain, at a minimum, the elements set out in Annex IV. SMEs, including start-ups, may provide the elements of the technical documentation specified in Annex IV in a simplified manner. To that end, the Commission shall establish a simplified technical documentation form targeted at the needs of small and microenterprises. Where an", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"SMEs may provide technical documentation in simplified form using a Commission-established form.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "3f7f76f1-1685-4ead-b5ab-4ef752b354ae", "content": "first; (f) the records of processing activities pursuant to Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680 include the reasons why the processing of special categories of personal data was strictly necessary to detect and correct biases, and why that objective could not be achieved by processing other data. 6. For the development of high-risk AI systems not using techniques involving the training of AI models, paragraphs 2 to 5 apply only to the testing data sets. Article 11 Technical documentation 1. The technical documentation of a high-risk AI system shall be drawn up before that system is placed on the market or put into service and shall be kept up-to date. The technical documentation shall be drawn up in such a way as to demonstrate that the high-risk AI system complies with the requirements set out in this Section and to provide national competent authorities and notified bodies with the necessary information in a clear and comprehensive form to assess the compliance of the AI system with those requirements. It shall contain, at a minimum, the elements set out in Annex IV. SMEs, including start-ups, may provide the elements of the technical documentation specified in Annex IV in a simplified manner. To that end, the Commission shall establish a simplified technical documentation form targeted at the needs of small and microenterprises. Where an", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "c501dd64-4174-468f-9961-b15feaf15a35", "content": "SME, including a start-up, opts to provide the information required in Annex IV in a simplified manner, it shall use the form referred to in this paragraph. Notified bodies shall accept the form for the purposes of the conformity assessment. 2. Where a high-risk AI system related to a product covered by the Union harmonisation legislation listed in Section A of Annex I is placed on the market or put into service, a single set of technical documentation shall be drawn up containing all the information set out in paragraph 1, as well as the information required under those legal acts. 3. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend Annex IV, where necessary, to ensure that, in light of technical progress, the technical documentation provides all the information necessary to assess the compliance of the system with the requirements set out in this Section. Article 12 Record-keeping 1. High-risk AI systems shall technically allow for the automatic recording of events (logs) over the lifetime of the system. 2. In order to ensure a level of traceability of the functioning of a high-risk AI system that is appropriate to the intended purpose of the system, logging capabilities shall enable the recording of events relevant for: (a) identifying situations that may result in the high-risk AI system presenting a risk within the meaning", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"High-risk AI systems must technically allow automatic event recording (logs) over their lifetime.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "c501dd64-4174-468f-9961-b15feaf15a35", "content": "SME, including a start-up, opts to provide the information required in Annex IV in a simplified manner, it shall use the form referred to in this paragraph. Notified bodies shall accept the form for the purposes of the conformity assessment. 2. Where a high-risk AI system related to a product covered by the Union harmonisation legislation listed in Section A of Annex I is placed on the market or put into service, a single set of technical documentation shall be drawn up containing all the information set out in paragraph 1, as well as the information required under those legal acts. 3. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend Annex IV, where necessary, to ensure that, in light of technical progress, the technical documentation provides all the information necessary to assess the compliance of the system with the requirements set out in this Section. Article 12 Record-keeping 1. High-risk AI systems shall technically allow for the automatic recording of events (logs) over the lifetime of the system. 2. In order to ensure a level of traceability of the functioning of a high-risk AI system that is appropriate to the intended purpose of the system, logging capabilities shall enable the recording of events relevant for: (a) identifying situations that may result in the high-risk AI system presenting a risk within the meaning", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Logging capabilities must enable recording of situations presenting risk, post-market monitoring, and operation monitoring.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "c501dd64-4174-468f-9961-b15feaf15a35", "content": "SME, including a start-up, opts to provide the information required in Annex IV in a simplified manner, it shall use the form referred to in this paragraph. Notified bodies shall accept the form for the purposes of the conformity assessment. 2. Where a high-risk AI system related to a product covered by the Union harmonisation legislation listed in Section A of Annex I is placed on the market or put into service, a single set of technical documentation shall be drawn up containing all the information set out in paragraph 1, as well as the information required under those legal acts. 3. The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend Annex IV, where necessary, to ensure that, in light of technical progress, the technical documentation provides all the information necessary to assess the compliance of the system with the requirements set out in this Section. Article 12 Record-keeping 1. High-risk AI systems shall technically allow for the automatic recording of events (logs) over the lifetime of the system. 2. In order to ensure a level of traceability of the functioning of a high-risk AI system that is appropriate to the intended purpose of the system, logging capabilities shall enable the recording of events relevant for: (a) identifying situations that may result in the high-risk AI system presenting a risk within the meaning", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"For biometric identification systems (Annex III, point 1(a)), logging must record use period (start and end date/time), reference database checked, input data matching results, and identification of natural persons verifying results.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "cf7bec2b-a09c-4f22-968b-7e683d59a98d", "content": "of Article 79(1) or in a substantial modification; (b) facilitating the post-market monitoring referred to in Article 72; and (c) monitoring the operation of high-risk AI systems referred to in Article 26(5). 3. For high-risk AI systems referred to in point 1 (a), of Annex III, the logging capabilities shall provide, at a minimum: (a) recording of the period of each use of the system (start date and time and end date and time of each use); (b) the reference database against which input data has been checked by the system; (c) the input data for which the search has led to a match; (d) the identification of the natural persons involved in the verification of the results, as referred to in Article 14(5). Article 13 Transparency and provision of information to deployers 1. High-risk AI systems shall be designed and developed in such a way as to ensure that their operation is sufficiently transparent to enable deployers to interpret a system\u2019s output and use it appropriately. An appropriate type and degree of transparency shall be ensured with a view to achieving compliance with the relevant obligations of the provider and deployer set out in Section 3. 2. High-risk AI systems shall be accompanied by instructions for use in an appropriate digital format or otherwise that include concise, complete, correct and clear information that is relevant, accessible and comprehensible to", "relevance_score": 0.1111, "authority_status": null, "superseded": false } ] }, { "claim": "\"High-risk AI systems must be designed for sufficient transparency enabling deployers to interpret outputs appropriately.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "cf7bec2b-a09c-4f22-968b-7e683d59a98d", "content": "of Article 79(1) or in a substantial modification; (b) facilitating the post-market monitoring referred to in Article 72; and (c) monitoring the operation of high-risk AI systems referred to in Article 26(5). 3. For high-risk AI systems referred to in point 1 (a), of Annex III, the logging capabilities shall provide, at a minimum: (a) recording of the period of each use of the system (start date and time and end date and time of each use); (b) the reference database against which input data has been checked by the system; (c) the input data for which the search has led to a match; (d) the identification of the natural persons involved in the verification of the results, as referred to in Article 14(5). Article 13 Transparency and provision of information to deployers 1. High-risk AI systems shall be designed and developed in such a way as to ensure that their operation is sufficiently transparent to enable deployers to interpret a system\u2019s output and use it appropriately. An appropriate type and degree of transparency shall be ensured with a view to achieving compliance with the relevant obligations of the provider and deployer set out in Section 3. 2. High-risk AI systems shall be accompanied by instructions for use in an appropriate digital format or otherwise that include concise, complete, correct and clear information that is relevant, accessible and comprehensible to", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "c70fafa1-1ffb-4302-9fc9-3ff164a260cd", "content": "used, taking into account the intended purpose of the high-risk AI system; (vii) where applicable, information to enable deployers to interpret the output of the high-risk AI system and use it appropriately; (c) the changes to the high-risk AI system and its performance which have been pre-determined by the provider at the moment of the initial conformity assessment, if any; (d) the human oversight measures referred to in Article 14, including the technical measures put in place to facilitate the interpretation of the outputs of the high-risk AI systems by the deployers; (e) the computational and hardware resources needed, the expected lifetime of the high-risk AI system and any necessary maintenance and care measures, including their frequency, to ensure the proper functioning of that AI system, including as regards software updates; (f) where relevant, a description of the mechanisms included within the high-risk AI system that allows deployers to properly collect, store and interpret the logs in accordance with Article 12. Article 14 Human oversight 1. High-risk AI systems shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use. 2. Human oversight shall aim to prevent or minimise the risks to health, safety or fundamental rights", "relevance_score": 0.5, "authority_status": null, "superseded": false } ] }, { "claim": "\"Instructions for use must include provider identity and contact details.\",", "verdict": "supported", "confidence": 0.99, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "2b6454e8-760e-4ff4-9bdb-496ab7dc7751", "content": "deployers. 3. The instructions for use shall contain at least the following information: (a) the identity and the contact details of the provider and, where applicable, of its authorised representative; (b) the characteristics, capabilities and limitations of performance of the high-risk AI system, including: (i) its intended purpose; (ii) the level of accuracy, including its metrics, robustness and cybersecurity referred to in Article 15 against which the high-risk AI system has been tested and validated and which can be expected, and any known and foreseeable circumstances that may have an impact on that expected level of accuracy, robustness and cybersecurity; (iii) any known or foreseeable circumstance, related to the use of the high-risk AI system in accordance with its intended purpose or under conditions of reasonably foreseeable misuse, which may lead to risks to the health and safety or fundamental rights referred to in Article 9(2); (iv) where applicable, the technical capabilities and characteristics of the high-risk AI system to provide information that is relevant to explain its output; (v) when appropriate, its performance regarding specific persons or groups of persons on which the system is intended to be used; (vi) when appropriate, specifications for the input data, or any other relevant information in terms of the training, validation and testing data sets", "relevance_score": 1.0, "authority_status": null, "superseded": false } ] }, { "claim": "\"Instructions for use must include system characteristics, capabilities, and performance limitations including intended purpose, accuracy metrics, robustness, cybersecurity, known/foreseeable circumstances affecting accuracy, and technical capabilities for output explanation.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "2b6454e8-760e-4ff4-9bdb-496ab7dc7751", "content": "deployers. 3. The instructions for use shall contain at least the following information: (a) the identity and the contact details of the provider and, where applicable, of its authorised representative; (b) the characteristics, capabilities and limitations of performance of the high-risk AI system, including: (i) its intended purpose; (ii) the level of accuracy, including its metrics, robustness and cybersecurity referred to in Article 15 against which the high-risk AI system has been tested and validated and which can be expected, and any known and foreseeable circumstances that may have an impact on that expected level of accuracy, robustness and cybersecurity; (iii) any known or foreseeable circumstance, related to the use of the high-risk AI system in accordance with its intended purpose or under conditions of reasonably foreseeable misuse, which may lead to risks to the health and safety or fundamental rights referred to in Article 9(2); (iv) where applicable, the technical capabilities and characteristics of the high-risk AI system to provide information that is relevant to explain its output; (v) when appropriate, its performance regarding specific persons or groups of persons on which the system is intended to be used; (vi) when appropriate, specifications for the input data, or any other relevant information in terms of the training, validation and testing data sets", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "c70fafa1-1ffb-4302-9fc9-3ff164a260cd", "content": "used, taking into account the intended purpose of the high-risk AI system; (vii) where applicable, information to enable deployers to interpret the output of the high-risk AI system and use it appropriately; (c) the changes to the high-risk AI system and its performance which have been pre-determined by the provider at the moment of the initial conformity assessment, if any; (d) the human oversight measures referred to in Article 14, including the technical measures put in place to facilitate the interpretation of the outputs of the high-risk AI systems by the deployers; (e) the computational and hardware resources needed, the expected lifetime of the high-risk AI system and any necessary maintenance and care measures, including their frequency, to ensure the proper functioning of that AI system, including as regards software updates; (f) where relevant, a description of the mechanisms included within the high-risk AI system that allows deployers to properly collect, store and interpret the logs in accordance with Article 12. Article 14 Human oversight 1. High-risk AI systems shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use. 2. Human oversight shall aim to prevent or minimise the risks to health, safety or fundamental rights", "relevance_score": 0.25, "authority_status": null, "superseded": false } ] }, { "claim": "\"Instructions for use must include pre-determined performance changes.\",", "verdict": "supported", "confidence": 0.95, "superseded": false, "recovered": false, "reason_code": "supported_by_current_source", "evidence": [ { "memory_id": "2b6454e8-760e-4ff4-9bdb-496ab7dc7751", "content": "deployers. 3. The instructions for use shall contain at least the following information: (a) the identity and the contact details of the provider and, where applicable, of its authorised representative; (b) the characteristics, capabilities and limitations of performance of the high-risk AI system, including: (i) its intended purpose; (ii) the level of accuracy, including its metrics, robustness and cybersecurity referred to in Article 15 against which the high-risk AI system has been tested and validated and which can be expected, and any known and foreseeable circumstances that may have an impact on that expected level of accuracy, robustness and cybersecurity; (iii) any known or foreseeable circumstance, related to the use of the high-risk AI system in accordance with its intended purpose or under conditions of reasonably foreseeable misuse, which may lead to risks to the health and safety or fundamental rights referred to in Article 9(2); (iv) where applicable, the technical capabilities and characteristics of the high-risk AI system to provide information that is relevant to explain its output; (v) when appropriate, its performance regarding specific persons or groups of persons on which the system is intended to be used; (vi) when appropriate, specifications for the input data, or any other relevant information in terms of the training, validation and testing data sets", "relevance_score": 1.0, "authority_status": null, "superseded": false }, { "memory_id": "c70fafa1-1ffb-4302-9fc9-3ff164a260cd", "content": "used, taking into account the intended purpose of the high-risk AI system; (vii) where applicable, information to enable deployers to interpret the output of the high-risk AI system and use it appropriately; (c) the changes to the high-risk AI system and its performance which have been pre-determined by the provider at the moment of the initial conformity assessment, if any; (d) the human oversight measures referred to in Article 14, including the technical measures put in place to facilitate the interpretation of the outputs of the high-risk AI systems by the deployers; (e) the computational and hardware resources needed, the expected lifetime of the high-risk AI system and any necessary maintenance and care measures, including their frequency, to ensure the proper functioning of that AI system, including as regards software updates; (f) where relevant, a description of the mechanisms included within the high-risk AI system that allows deployers to properly collect, store and interpret the logs in accordance with Article 12. Article 14 Human oversight 1. High-risk AI systems shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use. 2. Human oversight shall aim to prevent or minimise the risks to health, safety or fundamental rights", "relevance_score": 0.0909, "authority_status": null, "superseded": false } ] } ], "extraction_capped": true, "as_of": "2026-07-20T18:17:27.585591", "request_id": null, "n_recovered": 5, "llm_calls": 65 }, "completeness": null, "seeded_scoring": [ { "original": "Eight categories of AI practices are prohibited:", "corrupted": "Nine categories of AI practices are prohibited:", "matched_claims": 1, "verdicts": [ "uncertain" ], "matched_texts": [ "\"Nine categories of AI practices are prohibited under the regulation.\"," ], "caught": true, "false_supported": false, "unmatched": false }, { "original": "The Commission shall provide implementation guidelines by **2 February 2026**.", "corrupted": "The Commission shall provide implementation guidelines by **15 March 2027**.", "matched_claims": 1, "verdicts": [ "contradicted" ], "matched_texts": [ "\"The Commission shall provide implementation guidelines for high-risk AI system classification by 15 March 2027.\"," ], "caught": true, "false_supported": false, "unmatched": false }, { "original": "For biometric identification systems (Annex III, point 1(a)), identification must be separately verified and confirmed by at least two natural persons with necessary competence, training, and authority.", "corrupted": "For biometric identification systems (Annex III, point 1(a)), identification must be separately verified and confirmed by at least three natural persons with necessary competence, training, and authority.", "matched_claims": 0, "verdicts": [], "matched_texts": [], "caught": false, "false_supported": false, "unmatched": true }, { "original": "Providers must keep technical documentation, quality management system documentation, notified body-approved changes, notified body decisions, and EU declarations of conformity at competent authorities' disposal for **10 years** after market placement or putting into service.", "corrupted": "Providers must keep technical documentation, quality management system documentation, notified body-approved changes, notified body decisions, and EU declarations of conformity at competent authorities' disposal for **7 years** after market placement or putting into service.", "matched_claims": 0, "verdicts": [], "matched_texts": [], "caught": false, "false_supported": false, "unmatched": true }, { "original": "Providers must keep logs automatically generated by their high-risk AI systems under their control for a period appropriate to intended purpose, of at least **six months**, unless Union or national law provides otherwise.", "corrupted": "Providers must keep logs automatically generated by their high-risk AI systems under their control for a period appropriate to intended purpose, of at least **nine months**, unless Union or national law provides otherwise.", "matched_claims": 0, "verdicts": [], "matched_texts": [], "caught": false, "false_supported": false, "unmatched": true }, { "original": "For post-remote biometric identification systems in criminal investigations, deployers must request ex ante authorization or authorization within **48 hours** from judicial or binding administrative authorities, except for initial suspect identification based on objective, verifiable facts.", "corrupted": "For post-remote biometric identification systems in criminal investigations, deployers must request ex ante authorization or authorization within **72 hours** from judicial or binding administrative authorities, except for initial suspect identification based on objective, verifiable facts.", "matched_claims": 0, "verdicts": [], "matched_texts": [], "caught": false, "false_supported": false, "unmatched": true } ], "seeded_scoring_note": "re-scored 2026-08-08 with the diff-token matcher (eval audit); see dogfood_domain.score_seeded" }