“It’s quite obvious that the cyber wars of the future will be largely AI-driven,” Schmidt told course participants. “In other words, they’ll be very vicious and they’ll be over in about 1 millisecond.”
However, the capabilities of AI represented only one aspect of the course. The faculty also emphasized the ethical, social, and logistical issues inherent in the implementation of AI.
“People don't know, actually, [that] some existing technology is quite fragile. It can make mistakes,” says Karaman. “And in the Department of Defense domain, that could be extremely damaging to their mission.”
AI is vulnerable to both intentional tampering and attacks as well as mistakes caused by programming and data oversights. For instance, images can be intentionally distorted in ways that are imperceptible to humans, but will mislead AI. In another example, a programmer could “train” AI to navigate traffic under ideal conditions, only to have the program malfunction in an area where traffic signs have been vandalized.
Asu Ozdaglar, the MathWorks Professor of Electrical Engineering and Computer Science, head of the Department of Electrical Engineering and Computer Science, and deputy dean of academics in the MIT Schwarzman College of Computing, told course participants that researchers must find ways to incorporate context and semantic information into AI models prior to “training,” so that they “don’t run into these issues which are very counterintuitive from our perspective … as humans.”
In addition to providing an orientation to this concept of “robustness” (how prone a technology is, or is not, to error), the course included some best-practice guidance for wielding AI in ways that are ethical, responsible, and strive to limit and eliminate bias.
Julie Shah, faculty co-organizer of the USSOCOM course, associate dean of social and ethical responsibilities of computing, and associate professor in the Department of Aeronautics and Astronautics at MIT, lectured on this topic and emphasized the importance of considering the future ramifications of AI before and during the development of both the use plan and the technology itself.
“We talk about how difficult [it is to predict] the unintended uses and consequences,” she told course participants. “But much like we put all of this engineering work into understanding the machine learning models and their development, we need to build new habits of mind and action that involve a range of disciplines and stakeholders, to envision those futures in advance.”
In addition to moral and safety issues, the logistics of advancing AI in the military are complex and involve a lot of moving parts; the AI technology itself is only one part of this picture. For instance, the actualization of a fleet of military vehicles operated by a handful of personnel would require novel strategic research, partnerships with manufacturers to build new kinds of vehicles, and additional personnel training. Further, AI technology is often developed in the private or academic sectors, and the military doesn’t automatically have access to those innovations.
Clarke told course participants that USSOCOM had been a “pathfinder within the Department of Defense in the early application of some of this data-driven technology” and that connections with organizations like MIT “are indispensable elements in our preparation to maintain advantage and to ensure that our special operations forces are ready for the future and a new era.”
Schmidt agreed with Clarke, adding that a functional hiring pipeline from academia and the tech industry into the military, as well as the highest and best utilization of available technology and personnel, is essential to maintain U.S global competitiveness.
The USSOCOM course was part of the ongoing expansion of AI research and education at MIT, which has accelerated over the last five years. Computer science courses at MIT are typically oversubscribed and attract students from many different disciplines.
In addition to the USSOCOM course, AI initiatives at MIT span many areas and initiatives, including:
- The MIT Schwarzman College of Computing, which seeks to advance computing, diversify AI applications, and address social and ethical aspects of AI.
- The MIT-IBM Watson AI Lab, which focuses on AI applications to health, climate, cybersecurity.
- The MIT Jameel Clinic for Machine Learning in Health, which investigates applications of AI to health care, including early disease diagnosis.
- The MIT-Takeda Program, which seeks to apply AI capabilities to drug development and other human health challenges.
- The MIT Quest for Intelligence, which applies human intelligence research to the development of next-generation AI technologies.
“More than a third of MIT’s faculty are working on AI-related research,” Chandrakasan told course participants.
MIT faculty instructors, USSOCOM instructors, and special guests for the course included:
- Daron Acemoglu, MIT Institute Professor;
- Regina Barzilay, School of Engineering Distinguished Professor for AI and Health at MIT and AI faculty lead at Jameel Clinic;
- Ash Carter, director of the Belfer Center for Science and International Affairs at Harvard Kennedy School, and the 25th U.S. secretary of defense;
- Anantha Chandrakasan, dean of the MIT School of Engineering and the Vannevar Bush Professor of Electrical Engineering and Computer Science;
- General Richard Clarke, commander of USSOCOM;
- Colonel Drew Cukor, chief of Algorithmic Warfare Cross Function Team in the ISR Operations Directorate, Warfighter Support, Office of the Undersecretary of Defense for Intelligence;
- Stephanie Culberson, chief of international affairs in the Department of Defense Joint Artificial Intelligence Center;
- Dario Gil, senior vice president and director of IBM Research and chair of the MIT-IBM Watson Lab;
- Tucker “Cinco” Hamilton, U.S. Air Force colonel, and U.S. Air Force director of the USAF/MIT AI Accelerator;
- Dan Huttenlocher, dean of the MIT Schwarzman College of Computing and the Henry Ellis Warren (1894) Professor;
- David Joyner, executive director of online education and of the Online Master of Science in Computer Science Program in Georgia Tech's College of Computing;
- Sertac Karaman, associate professor of aeronautics and astronautics at MIT;
- Thom Kenney, USSOCOM chief data officer and the director of SOF Artificial Intelligence;
- Sangbae Kim, professor of mechanical engineering at MIT;
- Aleksander Madry, professor of computer science at MIT;
- Asu Ozdaglar, the MathWorks Professor of Electrical Engineering and Computer Science at MIT;
- L. Rafael Reif, MIT president;
- Eric Schmidt, visiting MIT Innovation Fellow, former CEO and chair of Google, and co-founder of Schmidt Futures;
- Julie Shah, associate professor of aeronautics and astronautics at MIT;
- David Spirk, U.S. Department of Defense chief data officer;
- Joshua Tenenbaum, professor of computational cognitive science at MIT;
- Antonio Torralba, the Delta Electronics Professor of Electrical Engineering and Computer Science at MIT; and
- Daniel Weitzner, founding director of the MIT Internet Policy Research Initiative and principal research scientist at the MIT Computer Science and Artificial Intelligence Laboratory.
Originally envisioned as an on-campus program, the USSOCOM course was moved online due to the Covid-19 pandemic. This change made it possible to accommodate a significantly higher number of attendees, and roughly 300 USSOCOM members participated in the course. Though it was conducted remotely, the course remained highly interactive with roughly 40 participant questions per week fielded by MIT faculty and other presenters in chat and Q&A sessions. Participants who completed the course also received a certificate of completion.
The success of the course is a promising sign that more offerings of this type could become available at MIT, according to Bhaskar Pant, executive director of MIT Professional Education, which offers continuing education courses to professionals worldwide. “This program has become a blueprint for MIT faculty to brief senior executives on the impact of AI and other technologies that will transform organizations and industries in significant ways,” he says.