| Part ofa series on |
| Algocracy |
|---|
 |
| Examples |
|
| Part ofa series on |
| Governance |
|---|
By level |
Government by algorithm[1] (also known asalgorithmic regulation,[2]regulation by algorithms,algorithmic governance,[3][4]algocratic governance,algorithmic legal order oralgocracy[5]) is an alternative form ofgovernment orsocial ordering where the usage of computeralgorithms is applied to regulations, law enforcement, and generally any aspect of everyday life such as transportation or land registration.[6][7][8][9][10] The term "government by algorithm" has appeared in academic literature as an alternative for "algorithmic governance" in 2013.[11] A related term, algorithmic regulation, is defined as setting the standard, monitoring and modifying behaviour by means of computational algorithms – automation ofjudiciary is in its scope.[12]
Government by algorithm raises new challenges that are not captured in thee-government literature and the practice of public administration.[13] Some sources equatecyberocracy, which is a hypotheticalform of government that rules by the effective use of information,[14][15][16] with algorithmic governance, although algorithms are not the only means of processing information.[17][18]Nello Cristianini and Teresa Scantamburlo argued that the combination of a human society and certain regulation algorithms (such as reputation-based scoring) forms asocial machine.[19]
.jpg)
.jpg)
In 1962, the director of the Institute for Information Transmission Problems of theRussian Academy of Sciences in Moscow (later Kharkevich Institute),[20]Alexander Kharkevich, published an article in the journal "Communist" about a computer network for processing information and control of the economy.[21][22] In fact, he proposed to make a network like the modern Internet for the needs of algorithmic governance (ProjectOGAS). This created a serious concern among CIA analysts.[23] In particular,Arthur M. Schlesinger Jr. warned that"by 1970 the USSR may have a radically new production technology, involving total enterprises or complexes of industries, managed by closed-loop, feedback control employingself-teaching computers".[23]
Between 1971 and 1973, theChilean government carried outProject Cybersyn during thepresidency of Salvador Allende. This project was aimed at constructing a distributeddecision support system to improve the management of the national economy.[24][2] Elements of the project were used in 1972 to successfully overcome the traffic collapse caused by aCIA-sponsored strike of forty thousand truck drivers.[25] Besides that initial project, Beer was involved in similar cybernetic projects across Latin America during the 1980s and 1990s, as the region gradually returned to democracy, particularly in Uruguay and Colombia, in which his Viable System Model's (VSM) was applied.[26]
Also in the 1960s and 1970s,Herbert A. Simon championedexpert systems as tools for rationalization and evaluation of administrative behavior.[27] The automation of rule-based processes was an ambition of tax agencies over many decades resulting in varying success.[28] Early work from this period includes Thorne McCarty's influential TAXMAN project[29] in the US and Ronald Stamper'sLEGOL project[30] in the UK. In 1993, the computer scientistPaul Cockshott from theUniversity of Glasgow and the economist Allin Cottrell from theWake Forest University published the bookTowards a New Socialism, where they claim to demonstrate the possibility of a democraticallyplanned economy built on modern computer technology.[31] The Honourable JusticeMichael Kirby published a paper in 1998, where he expressed optimism that the then-available computer technologies such aslegal expert system could evolve to computer systems, which will strongly affect the practice of courts.[32] In 2006, attorneyLawrence Lessig, known for the slogan"Code is law", wrote:
[T]he invisible hand of cyberspace is building an architecture that is quite the opposite of its architecture at its birth. This invisible hand, pushed by government and by commerce, is constructing an architecture that will perfect control and make highly efficient regulation possible[33]
Since the 2000s, algorithms have been designed and used toautomatically analyze surveillance videos.[34]
In his 2006 bookVirtual Migration,A. Aneesh developed the concept of algocracy — information technologies constrain human participation in public decision making.[35][36] Aneesh differentiated algocratic systems from bureaucratic systems (legal-rational regulation) as well as market-based systems (price-based regulation).[37]
In 2013, algorithmic regulation was coined byTim O'Reilly, founder and CEO of O'Reilly Media Inc.:
Sometimes the "rules" aren't really even rules. Gordon Bruce, the former CIO of the city of Honolulu, explained to me that when he entered government from the private sector and tried to make changes, he was told, "That's against the law." His reply was "OK. Show me the law." "Well, it isn't really a law. It's a regulation." "OK. Show me the regulation." "Well, it isn't really a regulation. It's a policy that was put in place by Mr. Somebody twenty years ago." "Great. We can change that!" [...] Laws should specify goals, rights, outcomes, authorities, and limits. If specified broadly, those laws can stand the test of time. Regulations, which specify how to execute those laws in much more detail, should be regarded in much the same way that programmers regard their code and algorithms, that is, as a constantly updated toolset to achieve the outcomes specified in the laws. [...] It's time for government to enter the age of big data. Algorithmic regulation is an idea whose time has come.[38]
In 2017, Ukraine'sMinistry of Justice ran experimentalgovernment auctions usingblockchain technology to ensure transparency and hinder corruption in governmental transactions.[39] "Government by Algorithm?" was the central theme introduced at Data for Policy 2017 conference held on 6–7 September 2017 in London.[40]
Asmart city is an urban area where collected surveillance data is used to improve various operations. Increase in computational power allows more automated decision making and replacement of public agencies by algorithmic governance.[41] In particular, the combined use of artificial intelligence and blockchains forIoT may lead to the creation ofsustainable smart city ecosystems.[42]Intelligent street lighting inGlasgow is an example of successful government application of AI algorithms.[43] A study of smart city initiatives in the US shows that it requires public sector as a main organizer and coordinator, the private sector as a technology and infrastructure provider, and universities as expertise contributors.[44]
Thecryptocurrency millionaire Jeffrey Berns proposed the operation oflocal governments inNevada by tech firms in 2021.[45] Berns bought 67,000 acres (271 km2) in Nevada's ruralStorey County (population 4,104) for $170,000,000 (£121,000,000) in 2018 in order to develop a smart city with more than 36,000 residents that could generate an annual output of $4,600,000,000.[45] Cryptocurrency would be allowed for payments.[45] Blockchains, Inc. "Innovation Zone" was canceled in September 2021 after it failed to secure enough water[46] for the planned 36,000 residents, through water imports from a site located 100 miles away in the neighboringWashoe County.[47] A similar water pipeline proposed in 2007 was estimated to cost $100 million and would have taken about 10 years to develop.[47] With additional water rights purchased from Tahoe Reno Industrial General Improvement District, "Innovation Zone" would have acquired enough water for about 15,400 homes – meaning that it would have barely covered its planned 15,000 dwelling units, leaving nothing for the rest of the projected city and its 22 million square-feet of industrial development.[47]
InSaudi Arabia, the planners ofThe Line assert that it will be monitored by AI to improve life by using data and predictive modeling.[48]
Tim O'Reilly suggested that data sources andreputation systems combined in algorithmic regulation can outperform traditional regulations.[38] For instance, once taxi-drivers are rated by passengers, the quality of their services will improve automatically and "drivers who provide poor service are eliminated".[38] O'Reilly's suggestion is based on thecontrol-theoretic concept offeed-back loop—improvements anddisimprovements of reputation enforce desired behavior.[19] The usage of feedback-loops for the management of social systems has already been suggested inmanagement cybernetics byStafford Beer before.[50]
These connections are explored byNello Cristianini and Teresa Scantamburlo, where the reputation-credit scoring system is modeled as an incentive given to the citizens and computed by asocial machine, so that rational agents would be motivated to increase their score by adapting their behaviour. Several ethical aspects of that technology are still being discussed.[19]
China'sSocial Credit System was said to be a mass surveillance effort with a centralized numerical score for each citizen given for their actions, though newer reports say that this is a widespread misconception.[51][52][53]
Smart contracts,cryptocurrencies, anddecentralized autonomous organization are mentioned as means to replace traditional ways of governance.[54][55][10] Cryptocurrencies are currencies which are enabled by algorithms without a governmentalcentral bank.[56]Central bank digital currency often employs similar technology, but is differentiated from the fact that it does use a central bank. It is soon to be employed by major unions and governments such as the European Union and China.Smart contracts are self-executablecontracts, whose objectives are the reduction of need in trusted governmental intermediators, arbitrations and enforcement costs.[57][58] A decentralized autonomous organization is anorganization represented by smart contracts that is transparent, controlled by shareholders and not influenced by a central government.[59][60][61] Smart contracts have been discussed for use in such applications as use in (temporary)employment contracts[62][63] and automatic transfership of funds and property (i.e.inheritance, upon registration of adeath certificate).[64][65][66][67] Some countries such as Georgia and Sweden have already launched blockchain programs focusing on property (land titles andreal estate ownership)[39][68][69][70] Ukraine is also looking at other areas too such asstate registers.[39]
According to a study ofStanford University, 45% of the studied US federal agencies have experimented with AI and related machine learning (ML) tools up to 2020.[1] US federal agencies counted the number ofartificial intelligence applications, which are listed below.[1] 53% of these applications were produced by in-house experts.[1] Commercial providers of residual applications includePalantir Technologies.[71]
In 2012,NOPD started a collaboration with Palantir Technologies in the field ofpredictive policing.[72] Besides Palantir's Gotham software, other similar (numerical analysis software) used by police agencies (such as the NCRIC) includeSAS.[73]
In the fight against money laundering,FinCEN employs the FinCEN Artificial Intelligence System (FAIS) since 1995.[74][75]
National health administration entities and organisations such as AHIMA (American Health Information Management Association) holdmedical records. Medical records serve as the central repository for planning patient care and documenting communication among patient and health care provider and professionals contributing to the patient's care. In the EU, work is ongoing on aEuropean Health Data Space which supports the use of health data.[76]
USDepartment of Homeland Security has employed the software ATLAS, which run onAmazon Cloud. It scanned more than 16.5 million records of naturalized Americans and flagged approximately 124,000 of them for manual analysis and review byUSCIS officers regardingdenaturalization.[77][78] They were flagged due to potential fraud, public safety and national security issues. Some of the scanned data came fromTerrorist Screening Database andNational Crime Information Center.
TheNarxCare is a US software,[79] which combines data from the prescription registries of variousU.S. states[80][81] and usesmachine learning to generate various three-digit "risk scores" for prescriptions of medications and an overall "Overdose Risk Score", collectively referred to as Narx Scores,[82] in a process that potentially includesEMS and criminal justice data[79] as well as court records.[83]
In Estonia, artificial intelligence is used in itse-government to make it more automated and seamless. A virtual assistant will guide citizens through any interactions they have with the government. Automated and proactive services "push" services to citizens at key events of their lives (including births, bereavements, unemployment). One example is the automated registering of babies when they are born.[84] Estonia'sX-Road system will also be rebuilt to include even more privacy control and accountability into the way the government uses citizen's data.[85]
In Costa Rica, the possible digitalization of public procurement activities (i.e. tenders for public works) has been investigated. The paper discussing this possibility mentions that the use of ICT in procurement has several benefits such as increasing transparency, facilitating digital access to public tenders, reducing direct interaction between procurement officials and companies at moments of high integrity risk, increasing outreach and competition, and easier detection of irregularities.[86]
Besides using e-tenders for regularpublic works (construction of buildings, roads), e-tenders can also be used forreforestation projects and othercarbon sink restoration projects.[87]Carbon sink restoration projectsmay be part of thenationally determined contributions plans in order to reach the nationalParis agreement goals.
Governmentprocurementaudit software can also be used.[88][89] Audits are performed in some countries aftersubsidies have been received.
Some government agencies provide track and trace systems for services they offer. An example istrack and trace for applications done by citizens (i.e. driving license procurement).[90]
Some government services useissue tracking systems to keep track of ongoing issues.[91][92][93][94]
Judges' decisions in Australia are supported by the"Split Up" software in cases of determining the percentage of a split after adivorce.[95]COMPAS software is used in the US to assess the risk ofrecidivism in courts.[96][97] According to the statement of Beijing Internet Court, China is the first country to create an internet court or cyber court.[98][99][100] The Chinese AI judge is avirtual recreation of an actual female judge. She "will help the court's judges complete repetitive basic work, including litigation reception, thus enabling professional practitioners to focus better on their trial work".[98] Also,Estonia plans to employ artificial intelligence to decide small-claim cases of less than €7,000.[101]
Lawbots can perform tasks that are typically done by paralegals or young associates at law firms. One such technology used by US law firms to assist in legal research is from ROSS Intelligence,[102] and others vary in sophistication and dependence on scriptedalgorithms.[103] Another legal technologychatbot application isDoNotPay.
Due to the COVID-19 pandemic in 2020, in-person final exams were impossible for thousands of students.[104] The public high schoolWestminster High employed algorithms to assign grades. UK'sDepartment for Education also employed a statistical calculus to assign final grades inA-levels, due to the pandemic.[105]
Besides use in grading, software systems like AI were used in preparation for college entrance exams.[106]
AI teaching assistants are being developed and used for education (e.g. Georgia Tech's Jill Watson)[107][108] and there is also an ongoing debate on the possibility of teachers being entirely replaced by AI systems (e.g. inhomeschooling).[109]
In 2018, an activist named Michihito Matsuda ran for mayor in theTama city area of Tokyo as a human proxy for anartificial intelligence program.[110] While election posters and campaign material used the termrobot, and displayedstock images of a feminineandroid, the "AI mayor" was in fact amachine learning algorithm trained using Tama city datasets.[111] The project was backed by high-profile executives Tetsuzo Matsumoto ofSoftbank and Norio Murakami ofGoogle.[112] Michihito Matsuda came third in the election, being defeated byHiroyuki Abe.[113] Organisers claimed that the 'AI mayor' was programmed to analyzecitizen petitions put forward to thecity council in a more 'fair and balanced' way than human politicians.[114]
In 2018,Cesar Hidalgo presented the idea ofaugumented democracy.[115] In an augumented democracy, legislation is done bydigital twins of every single person.
In 2019, AI-powered messengerchatbot SAM participated in the discussions on social media connected to an electoral race in New Zealand.[116] The creator of SAM, Nick Gerritsen, believed SAM would be advanced enough to run as acandidate by late 2020, when New Zealand had its next general election.[117]
In 2022, the chatbot "Leader Lars" or "Leder Lars" was nominated forThe Synthetic Party to run in the 2022Danish parliamentary election,[118] and was built by the artist collectiveComputer Lars.[119] Leader Lars differed from earlier virtual politicians by leading apolitical party and by not pretending to be an objective candidate.[120] This chatbot engaged in critical discussions on politics with users from around the world.[121]
In November 2023, in the Japanese town ofManazuru, a mayoral candidate called "AI Mayer" hoped to be the first AI-powered officeholder in Japan. This candidacy was said to be supported by a group led by Michihito Matsuda.[122]
In the2024 United Kingdom general election, a businessman named Steve Endacott ran for the constituency ofBrighton Pavilion as an AI avatar named "AI Steve",[123] saying that constituents could interact with AI Steve to shape policy. Endacott stated that he would only attend Parliament to vote based on policies which had garnered at least 50% support.[124] AI Steve placed last with 179 votes.[125]
On September 11, 2025,Albania'sPrime MinisterEdi Rama appointedAI chatbot Diella to the seat of Minister forPublic Procurements.[126] The move, he claimed, would make Albania "a country where 100% of public tenders are free of corruption".[127] He stated that the process would be "step-by-step", and that "Albania's public tenders will be "100 percent incorruptible and where every public fund that goes through the tender procedure is 100 percent legible."[126] Leaving it up to interpretation whether he was talking about her appointment, or the process of automatingpublic procurements using Diella. Public opinion is torn on the topic of whether Albania should use Diella for this purpose. ManyEastern-Europeans are claiming the move is a step in the right direction, and that Albania is advancing.[128] ManyWesterners, however, have approached the move with a more critical lens, saying it is a dangerous and reckless move to place billions in public funding in the hands of an AI.[129]
.jpg)
In February 2020, China launched amobile app to deal with theCoronavirus outbreak[131] called "close-contact-detector".[132] Users are asked to enter their name and ID number. The app is able to detect "close contact" using surveillance data (i.e. using public transport records, including trains and flights)[132] and therefore a potential risk of infection. Every user can also check the status of three other users. To make this inquiry users scan a Quick Response (QR) code on their smartphones using apps likeAlipay orWeChat.[133] The close contact detector can be accessed via popular mobile apps including Alipay. If a potential risk is detected, the app not only recommends self-quarantine, it also alerts local health officials.[134]
Alipay also has theAlipay Health Code which is used to keep citizens safe. This system generates a QR code in one of three colors (green, yellow, or red) after users fill in a form on Alipay with personal details. A green code enables the holder to move around unrestricted. A yellow code requires the user to stay at home for seven days and red means a two-week quarantine. In some cities such as Hangzhou, it has become nearly impossible to get around without showing one's Alipay code.[135]
In Cannes, France, monitoring software has been used on footage shot byCCTV cameras, allowing to monitor their compliance to localsocial distancing andmask wearing during the COVID-19 pandemic. The system does not store identifying data, but rather allows to alert city authorities and police where breaches of the mask and mask wearing rules are spotted (allowingfining to be carried out where needed). The algorithms used by the monitoring software can be incorporated into existing surveillance systems in public spaces (hospitals, stations, airports, shopping centres, ...)[136]
Cellphone data is used to locate infected patients in South Korea, Taiwan, Singapore and other countries.[137][138] In March 2020, the Israeli government enabled security agencies to track mobile phone data of people supposed to have coronavirus. The measure was taken to enforce quarantine and protect those who may come into contact with infected citizens.[139] Also in March 2020,Deutsche Telekom shared private cellphone data with the federal government agency,Robert Koch Institute, in order to research and prevent the spread of the virus.[140] Russia deployedfacial recognition technology to detect quarantine breakers.[141] Italian regional health commissionerGiulio Gallera said that "40% of people are continuing to move around anyway", as he has been informed by mobile phone operators.[142] In USA, Europe and UK,Palantir Technologies is taken in charge to provide COVID-19 tracking services.[143]
Tsunamis can be detected bytsunami warning systems. They can make use of AI.[144][145]Floodings can also be detected using AI systems.[146]Wildfires can be predicted using AI systems.[147][148]Wildfire detection is possible by AI systems (i.e. through satellite data, aerial imagery, and GPS phone personnel position) and can help in the evacuation of people during wildfires,[149] to investigate how householders responded in wildfires[150] and spotting wildfire in real time usingcomputer vision.[151][152]Earthquake detection systems are now improving alongside the development of AI technology through measuring seismic data and implementing complex algorithms to improve detection and prediction rates.[153][154][155] Earthquake monitoring, phase picking, and seismic signal detection have developed through AI algorithms ofdeep-learning, analysis, and computational models.[156]Locust breeding areas can be approximated using machine learning, which could help to stop locust swarms in an early phase.[157]
Algorithmic regulation is supposed to be a system of governance where more exact data, collected from citizens via their smart devices and computers, is used to more efficiently organize human life as a collective.[158][159] AsDeloitte estimated in 2017, automation of US government work could save 96.7 million federal hours annually, with a potential savings of $3.3 billion; at the high end, this rises to 1.2 billion hours and potential annual savings of $41.1 billion.[160]
There are potential risks associated with the use of algorithms in government. Those include:
According to a 2016's bookWeapons of Math Destruction, algorithms andbig data are suspected to increase inequality due to opacity, scale and damage.[163]
There is also a serious concern thatgaming by the regulated parties might occur, once moretransparency is brought into the decision making by algorithmic governance, regulated parties might try to manipulate their outcome in own favor and even useadversarial machine learning.[1][19] According toHarari, the conflict between democracy and dictatorship is seen as a conflict of two different data-processing systems—AI and algorithms may swing the advantage toward the latter by processing enormous amounts of information centrally.[164]
In 2018, the Netherlands employed an algorithmic system SyRI (Systeem Risico Indicatie) to detect citizens perceived as being high risk for committingwelfare fraud, which quietly flagged thousands of people to investigators.[165] This caused a public protest. The district court of Hague shut down SyRI referencingArticle 8 of the European Convention on Human Rights (ECHR).[166]
The contributors of the 2019 documentaryiHuman expressed apprehension of "infinitely stable dictatorships" created by government AI.[167]
Due to public criticism, the Australian government announced the suspension ofRobodebt scheme key functions in 2019, and a review of all debts raised using the programme.[168]
In 2020, algorithms assigning exam grades to students in theUK sparked open protest under the banner "Fuck the algorithm."[105] This protest was successful and the grades were taken back.[169]
In 2020, the US government softwareATLAS, which run onAmazon Cloud, sparked uproar from activists and Amazon's own employees.[170]
In 2021, Eticas Foundation launched a database of governmental algorithms calledObservatory of Algorithms with Social Impact (OASI).[171]
A 2023 Annual Review synthesis highlights that regulating government use of AI requires sociotechnical design that addresses accountability, transparency, and bias.[1]
An initial approach towards transparency included theopen-sourcing of algorithms.[172] Software code can be looked into and improvements can be proposed throughsource-code-hosting facilities.
A 2019 poll conducted byIE University's Center for the Governance of Change in Spain found that 25% of citizens from selected European countries were somewhat or totally in favor of letting an artificial intelligence make important decisions about how their country is run.[173] The following table lists the results by country:
| Country | Percentage |
|---|---|
| France | 25% |
| Germany | 31% |
| Ireland | 29% |
| Italy | 28% |
| Netherlands | 43% |
| Portugal | 19% |
| Spain | 26% |
| UK | 31% |
Researchers found some evidence that when citizens perceive their political leaders or security providers to be untrustworthy, disappointing, or immoral, they prefer to replace them by artificial agents, whom they consider to be more reliable.[174] The evidence is established by survey experiments on university students of all genders.
A 2021 poll byIE University indicates that 51% of Europeans are in favor of reducing the number of national parliamentarians and reallocating these seats to an algorithm. This proposal has garnered substantial support in Spain (66%), Italy (59%), and Estonia (56%). Conversely, the citizens of Germany, the Netherlands, the United Kingdom, and Sweden largely oppose the idea.[175] The survey results exhibit significant generational differences. Over 60% of Europeans aged 25–34 and 56% of those aged 34–44 support the measure, while a majority of respondents over the age of 55 are against it. International perspectives also vary: 75% of Chinese respondents support the proposal, whereas 60% of Americans are opposed.[175]
The 1970David Bowie song "Saviour Machine" depicts an algocratic society run by the titular mechanism, which ended famine and war through "logic" but now threatens to cause an apocalypse due to its fear that its subjects have become excessively complacent.[176]
The novelsDaemon (2006) andFreedom™ (2010) byDaniel Suarez describe a fictional scenario of global algorithmic regulation.[177]Matthew De Abaitua'sIf Then imagines an algorithm supposedly based on "fairness" recreating a premodern rural economy.[178]
