Friday, November 15, 2024

AI Watch: Global regulatory tracker – European Union | White & Case LLP

Must read

Laws/Regulations directly regulating AI (the “AI Regulations”)

The primary legislative framework for regulating AI in the EU is the EU AI Act (here; finalized text here). The EU has also proposed the AI Liability Directive (here) which is designed to ensure that liability rules are appropriately applied to AI-related claims.

Status of the AI Regulations 

The EU AI Act was finalized and endorsed by all 27 EU Member States on February 2, 2024, and by the European Parliament on March 13, 2024. After final approval by the Council of the EU on May 21, 2024, the EU AI Act is now set to be published in the EU’s Official Journal. The EU AI Act will enter into force on the 20th day after publication, and will be effective after 24 months,1 except for the specific provisions listed in Article 113. The official entry into force is expected around mid-June of this year.2

The AI Liability Directive is in draft form and is yet to be considered by the European Parliament and Council of the EU.3 Timing remains uncertain.

Related laws affecting AI

There are many laws applicable in the EU that may affect the development or use of AI in the EU. A non-exhaustive list of common examples includes:

  • The EU General Data Protection Regulation (EU) 2016/679
  • The Product Liability Directive, which, if adopted, will allow people harmed by software (including AI software) to receive compensation from the software manufacturer (replacing Directive 85/374/EEC)
  • The General Product Safety Regulation 2023/988/EU, replacing Directive 2001/95/EC
  • Various intellectual property laws under the national laws of EU Member States

Definition of “AI” 

AI is defined in the EU AI Act using the following terms:

  • AI system” means “a machine-based system that is designed to operate with varying levels of autonomy and that may exhibit adaptiveness after deployment, and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments”
  • General-purpose AI model” means “an AI model, including where such an AI model is trained with a large amount of data using self-supervision at scale, that displays significant generality and is capable of competently performing a wide range of distinct tasks regardless of the way the model is placed on the market and that can be integrated into a variety of downstream systems or applications, except AI models that are used for research, development or prototyping activities before they are placed on the market”
  • General-purpose AI system means “an AI system which is based on a general-purpose AI model and which has the capability to serve a variety of purposes, both for direct use as well as for integration in other AI systems”4 

The AI Liability Directive will likely adopt the same definition as the EU AI Act.5

Territorial scope 

The EU AI Act applies extraterritorially to:6

  • Any provider placing, or otherwise putting into service, an AI system or general-purpose AI models on the EU market, regardless of whether the provider is established or located within the EU or in a third country
  • Any deployers of AI systems who have their place of establishment in, or who are located in, the EU
  • Any provider or deployer of an AI system that have their place of establishment or are otherwise located in a third country, if the output produced by the AI system is intended to be used in the EU7

The AI Liability Directive applies to non-contractual fault-based civil law claims within the EU.8

Sectoral scope 

The EU AI Act is not sector-specific. It applies to all sectors. 

The AI Liability Directive is not sector-specific. It applies to non-contractual fault-based civil law claims brought before national courts.

Compliance roles

Under the EU AI Act:

  • Any developer of an AI system or general-purpose AI model, or any natural or legal person, public authority, agency or other body that has an AI system or general-purpose AI model developed and places them or puts the system into service on the EU market are “providers” under the AI Act
  • Any natural or legal person in the supply chain that is not a provider or importer and makes an AI system available on the EU market is a “distributor” under the AI Act9
  • Any natural or legal person located or established in the Union that places on the market an AI system that bears the name or trademark of a natural or legal person established in a third country are “importers” under the AI Act10
  • Any natural or legal person, public authority, agency or other body using an AI system under its authority except where the AI system is used in the course of a personal non-professional activity are “deployers” under the AI Act11
  • Any provider, product manufacturer, deployer, importer, distributor or authorized representative are “operators” under the AI Act12

Each of these roles comes with a set of compliance obligations.

The AI Liability Directive would increase the likelihood of a successful claim against an AI system developer or the user of an AI system that relied on its output.13
 

Core issues that the AI Regulations seek to address

The EU AI Act is intended to promote the uptake of human-centric and trustworthy AI and to ensure a high level of protection of health, safety, fundamental rights, democracy, and rule of law from harmful effects of AI systems while supporting innovation and the functioning of the internal market.14

The AI Liability Directive aims to ensure that persons harmed by AI systems enjoy the same level of protection as persons harmed by other technologies in the EU. Current fault-based liability rules are not suited to handling liability claims for damage caused by AI-enabled products and services. Specifically, it may be difficult (or prohibitively expensive) for victims to prove the fault of a potentially liable person, and/or the causal link between the fault and the damage suffered, owing to the complexity, autonomy and opacity of AI systems.

Risk categorization

The EU AI Act classifies AI systems, and imposes requirements, according to different levels of risk:

  • Unacceptable risk:  AI systems that present an “unacceptable” risk  are prohibited. This includes (among others) AI systems used for social scoring and AI systems that use deceptive or exploitative techniques to materially distort a person’s behavior in a manner that can cause harm.16
  • High risk: AI systems that present a “high” risk include AI systems. These fall within two categories: (i) AI systems used as a safety component of a product (or otherwise subject to EU health and safety harmonization legislation); or (ii) AI systems deployed in eight specific areas, including (among others) education, employment, access to essential public and private services, law enforcement, migration, and the administration of justice.17
  • Limited risk: AI systems that present “limited” risk include those that directly interact with natural persons (e.g., chatbots), emotion recognition systems, biometric categorization systems, and AI systems that generate “deep fakes” (i.e., audio or visual content that appears genuine, even though it is created by an AI system) are required to disclose the fact that the content has been artificially generated or manipulated.18 The transparency obligations imposed on deployers of these AI systems do not apply where the use is authorized by law to detect, prevent, investigate and prosecute criminal offenses. If the content is “evidently” an artistic, creative, satirical, fictional analogous work or program, these obligations are limited to the disclosure of existence of “deep fakes” in an appropriate manner that does not hamper the display or environment of the work.19
  • Low or minimal risk: Any AI system not caught by the above are of low or minimal risk.20

The AI Liability Directive does not directly govern the risks posed by AI systems.

Key compliance requirements

Compliance obligations are primarily determined by the level of risk associated with the relevant AI system:

  • Unacceptable risk: AI systems posing an unacceptable risk are not subject to compliance requirements; they are prohibited outright
  • High risk: AI systems and their providers (or where applicable, the authorized representative) must be registered in an EU database before being placed onto the EU market or put into service, and must comply with a wide range of requirements on data training and data governance, technical documentation, recordkeeping, technical robustness, transparency, human oversight, and cybersecurity21
  • Limited risk: Providers and deployers of certain AI systems and general-purpose AI models are subject to transparency obligations22  
  • Low or minimal risk: AI systems do not have specific obligations or requirements under the EU AI Act23

The EU AI Act also provides for the development of codes of conduct for AI systems, which the Commission hopes all AI system providers will voluntarily apply.24

The AI Liability Directive does not contain compliance requirements.

Regulators

Enforcement of the EU AI Act involves a combination of authorities. EU Member States will establish or designate at least one notifying authority and at least one market surveillance authority (together, the “national competent authorities”) and ensure that the national competent authorities have adequate technical, financial and human resources, and infrastructure (that are sufficiently knowledgeable) to fulfill its tasks under the EU AI Act.25

The notifying authority is responsible for setting up and carrying out the assessment and designation procedures that are required under the EU AI Act, in an objective and impartial manner.26

The market surveillance authority may vary for “high” risk AI systems, AI systems used by financial institutions subject to EU legislation on financial services, and other EU institutions, agencies, and bodies.27

The market surveillance authority is primarily responsible for enforcement at the national level.28 If an AI system is non-compliant, the market surveillance authorities can exercise the enforcement powers described below. The market surveillance authorities will report to the Commission and relevant national competition authorities on an annual basis.29

Additionally, an AI Office within the Commission will enforce the common rules across the EU. Enforcement will be supported by a scientific panel of independent experts. An AI Board with Member States’ representatives will advise and assist the Commission and Member States on the consistent and effective application of the AI Act. Finally, an advisory forum for stakeholders will provide technical expertise to the AI Board and the Commission.

National courts of EU Member States will be responsible for implementing the AI Liability Directive in the case of non-contractual fault-based civil law claims brought before them.

Enforcement powers and penalties

Where the market surveillance authority finds that there is: (i) non-compliance with the obligations of the EU AI Act; or (ii) compliance from a high-risk AI system with the obligations of the EU AI Act, but still presents a risk to the health and safety of persons, the fundamental rights of persons, or other aspects of public interest protection; then the relevant market surveillance authority can (a) require the relevant operator to take all appropriate corrective actions (in the event of (ii), to ensure the AI system concerned no longer presents that risk) or withdraw/recall the AI system from the market; or (b) where the operator fails to do so, the relevant authority shall prohibit/restrict the AI system being made available on its national market or put into service, or withdraw/recall the product or the standalone AI system from the market.30

Penalties range from (i) the higher of €35,000,000 or up to 7 percent of a company’s total worldwide annual turnover for non-compliance with prohibited AI practices, to (ii) the higher of €7,500,000 or up to 1 percent of a company’s total worldwide annual turnover for the supply of incorrect, incomplete, or misleading information to notified bodies and national competent authorities.31

The AI Liability Directive increases the claimants’ likelihood of a successful claim by creating a rebuttable presumption of causality on the defendant. In practice, the new rule means that if a victim can show that someone was at fault for not complying with a certain obligation relevant to their harm, and that a causal link with the AI performance is reasonably likely, the court can presume that this non-compliance caused the damage.32

The AI Liability Directive also gives national courts the power to order disclosure of evidence about high risk AI systems that are suspected of causing damage, to help victims access relevant evidence to identify the person(s) that could be held liable.33

1 See EU AI Act, Article 113.
2 See the
Council’s press release.
3 See
Procedure File: 2022/0303(COD) | Legislative Observatory | European Parliament (europa.eu).
4 See
EU AI Act, Articles 3(1), 3(63) and 3(66).
5 See
AI Liability Directive, Article 2(1).
6 See
EU AI Act, Articles 2(1)(a) to (c). Responsibilities along the AI value chain (including distributors, importers, deployers) are set out in Article 25.
7 See
EU AI Act, Recital 22.
8 See
AI Liability Directive. Article 1(2).
9 See
EU AI Act, Article 3(7).
10 See
EU AI Act, Article 3(6) .
11 See
EU AI Act, Article 3(4). 
12 See
EU AI Act, Article 3(8). 
13 See
AI Liability Directive, Article 4(b).
14 See “Purpose” in the Procedure File
: printficheglobal.pdf (europa.eu); and EU AI Act, Article 1(1)
15 See
EU AI Act, Recital 179.
16 See
EU AI Act, Article 5.
17 See
EU AI Act, Article 6 and Annex III. 
18 See
EU AI Act, Articles 50(1) to 50(4).
19 See
EU AI Act, Article 50(4).
20 See page 4 of the
briefing note.
21 See EU AI Act, Articles 8-15 and 49.
22 See EU AI Act, Article 50.
23 See page 4 of the briefing note.
24 See EU AI Act, Chapter X (Codes of Conduct and guidelines).
25 See EU AI Act, Article 70.
26  See EU AI Act, Article 32.
27 See EU AI Act, Article 80.
28 See EU AI Act, Article 80.
29 See EU AI Act, Article 74.
30 See EU AI Act, Articles 80(1) to(3), 80(4) and 82 (1).
31 See EU AI Act, Articles 99(3) and (5).
32 See AI Liability Directive, Article 4(1).
33 See AI Liability Directive, Article 3(1).

White & Case means the international legal practice comprising White & Case LLP, a New York State registered limited liability partnership, White & Case LLP, a limited liability partnership incorporated under English law and all other affiliated partnerships, companies and entities.

This article is prepared for the general information of interested persons. It is not, and does not attempt to be, comprehensive in nature. Due to the general nature of its content, it should not be regarded as legal advice.

© 2024 White & Case LLP

Timo Gaudszun (Legal Intern, White & Case, Berlin), Jeffrey Shin (Trainee Solicitor, White & Case, London) and Daniel Mair (Trainee Solicitor, White & Case, Paris) contributed to this publication.

Latest article