Suresh Venkatasubramanian
On March 6, 2025, Axios reported that the State Department had launched a new social media surveillance program called “Catch and Revoke.” The intended goal of this program was to use artificial intelligence to assist in reviewing “tens of thousands of student visa holders’ social media footprints” to find “evidence of alleged terrorist sympathies expressed after Hamas’ attack on Israel.”
Whether you find this a horrifying development, an exciting application of AI, a flagrant violation of First Amendment rights, or even just a headscratcher, this incident captures the dynamics of how artificial intelligence, surveillance, and threats to democracy all come together. In a nutshell: AI’s promise of behavior prediction and control fuels a vicious cycle of surveillance which inevitably triggers abuses of power.
Throughout history, humans have always searched for ways to predict (and control) behavior, whether this constituted consulting an oracle, throwing bones, reading tea leaves, or even examining the shape of a person’s face and body to determine personality traits (which seems awfully contemporary if you start diving into the literature on “emotion AI”). As people became more adept at collecting data of various kinds, the field of statistics emerged to aid them in using data for prediction. (One of the amusing facts about AI research is that virtually every debate one encounters about the appropriate use of artificial intelligence in some social setting has parallels in history, often much earlier, which make it clear that efforts to predict and control behavior was never about AI at all.)
The problem with using data to make predictions is that the process can be used as a weapon against society, threatening democratic values. As the lines between private and public data are blurred in modern society, many won’t realize that their private lives are becoming data points used to make decisions about them. AI has supercharged these capabilities, smoothing out people’s individuality and instead placing each person into a group that’s deemed to behave a certain way. And while data and AI can be used for good, the only way these beneficial outcomes can be achieved is with restrictive, well-designed controls to prevent damage to democracy, much like humans did with nuclear energy.
No comments:
Post a Comment