India Considers Regulation for Automated Decision-Making

India's legal system is currently considering a case that could shape the country's approach to regulating automated decision-making. Two brothers from Hyderabad have challenged the Election Commission of India's use of software in court, arguing it removed them from the electoral roll without proper procedure.

The case emerges as many public and private services in India, including telecom operators and lenders, increasingly rely on automated systems for decision-making. Unlike regions such as California, Colorado, and the European Union, India's Digital Personal Data Protection Act, 2023, lacks explicit provisions on automated decision-making. This leaves users unclear about the basis for decisions and avenues for appeal.

In the lawsuit, the brothers are requesting that deletions from the electoral roll solely based on software-generated flags should not occur without an official verification and a reasoned order after a hearing. They also ask the Election Commission to disclose the system's operating principles, algorithms, and audit reports. The aim is to ensure that fundamental rights, like the right to vote, are not denied without a transparent and fair process.

The Election Commission has stated it will investigate and form a committee to review its ECINET platform against legislation. However, as observed in other jurisdictions, a human's mere sign-off on an automated system's decision may not guarantee fairness if the time spent on review is minimal or the process lacks transparency.

India is expected to examine international examples and develop its own legislation for automated decision-making. This court case could provide the first draft of necessary regulations, ensuring citizens' rights to understand and challenge algorithm-driven decisions.