Social Media Monitoring Tools
Babel Street
BabelX is the flagship product of the social media monitoring company Babel Street, which, according to the company, collects information from dozens of social media platforms and across the internet, allowing its users to search for and analyze information in hundreds of languages. The DC fusion center has had access to Babel Street since at least August 2014, when the company conducted a demonstration of its social media monitoring capabilities.
Fusion centers are intelligence hubs developed in the aftermath of 9/11 to share counterterrorism information and criminal intelligence among local, state, and federal government entities and some private organizations. The district’s fusion center — formerly the Washington Regional Threat Analysis Center until it was renamed the National Capital Regional Threat Intelligence Consortium in 2018 — is overseen by DC’s Homeland Security and Emergency Management Agency (HSEMA).
In 2015, the fusion center created filters on BabelX to collect information from social media on behalf of the MPD, including posts related to homicides and threats against local law enforcement officers. Fusion center personnel reviewed this information before sharing the most relevant postings with the MPD. It appears that the MPD provided the fusion center with search terms. For example, the assistant chief who managed the MPD’s Homeland Security Bureau stated that the department would provide the fusion center with a “generic glossary of the most common [slang] terms” to use on Babel Street. In another instance, the MPD provided Babel Street with keywords to search for information related to an event at Robert F. Kennedy Stadium that included terms related to both assemblies and potential threats, such as “protest,” “demonstration,” “rally,” “armed,” and “evacuation.”
In April 2015 Babel Street provided HSEMA with a spreadsheet compiling social media accounts that were “geo-located in both Ferguson [Missouri] and Baltimore during times of unrest” — presumably referring to the protests after the deaths of Michael Brown and Freddie Gray, respectively. Accounts to news organizations and journalists were excluded. The spreadsheet also contains a list of 58 social media users who Babel Street determined were “common connections” between the accounts in its first list — in other words, individuals or groups who did not necessarily have a connection to the protests but simply had a connection to those who did. Though HSEMA ultimately provided the spreadsheet to the MPD, it is unclear whether either agency subjected the social media users included in the spreadsheet to further scrutiny.
We also obtained procurement documents from 2016–2020 showing that BabelX licenses were purchased for the DC fusion center, as well as a memorandum of understanding between the MPD and HSEMA that provides the police department access to the fusion center’s social media monitoring tools, which would include Babel Street. It is unclear whether the fusion center continues to have access to BabelX.
Dataminr
Dataminr, a company affiliated with Twitter, provides a FirstAlert tool that gives clients customized, real-time alerts about events uncovered through social media. Dataminr provided the MPD with 40 user licenses during a no-cost pilot in January and February 2017. During its trial, the MPD collected information from social media related to events including “riots” during President Trump’s inauguration and during the first Women’s March. In February 2018, the MPD purchased seven annual Dataminr licenses at a cost of almost $48,000 using State Homeland Security Grant program funds from the Department of Homeland Security. According to internal communications, six of these licenses would be provided to the DC fusion center, and the MPD would have access to “unlimited licenses for the first year” of the contract, which it would provide to the department’s Command Information Center.
The Brennan Center and D4BL did not obtain procurement documents beyond the February 2018 purchase. However, it appears that the MPD lost access to Dataminr at some point before June 2020. In May 2020, Dataminr sent the MPD two promotional papers, including one in which it claimed that its FirstAlert tool had unearthed some of the very first indications of the Covid-19 pandemic in December 2019. Soon after, an MPD representative contacted the District’s Office of the Chief Technology Officer (OCTO), which paid about $200,000 for 50 Dataminr licenses, 45 of which it provided to HSEMA. On May 29, 2020, OCTO’s chief data officer responded to the MPD, stating that HSEMA could provide the MPD with some of its unused Dataminr licenses, which he said “would be very handy” for the MPD’s response to protests in the aftermath of George Floyd’s murder. The MPD gained access to Dataminr seemingly through an arrangement with HSEMA.
The Brennan Center and D4BL obtained more than 700,000 pages of email notifications from Dataminr First Alert to members of the MPD, dated between June 4, 2020, and May 20, 2022. In these emails, Dataminr sent the MPD information about protests, including real-time information about anticipated demonstrations, where protests were forming and moving, and protesters’ activities, often without any apparent connection to public safety.
Dataminr’s transmissions to the MPD belie the company’s position that it only provides news alerts to law enforcement and does not permit the use of its tool to surveil First Amendment–protected activity. The tension between Dataminr’s capabilities and its policy against surveillance was apparent in one December 2020 exchange between the company and the MPD when an MPD representative noted that Dataminr had failed to flag for the department “social media chatter” in the run-up to January 6, 2021. In response, one Dataminr employee stated that the company could not alert law enforcement about the “planning or scheduling of protests or demonstrations,” even though the company had provided this type of information to the MPD during the summer of 2020. The MPD replied that it was “concerned with the threats of ‘armed protesters’ and people planning on bringing firearms” to the district.
Sprinklr
The MPD used Sprinklr on a trial basis from January to March 2017, a period that mostly coincided with the Dataminr trial. Like Dataminr, Sprinklr’s social media monitoring tool appears to rely on a user’s search terms to scour online platforms for relevant postings. During the trial, the MPD obtained six Sprinklr licenses that it distributed to the “POI team,” the Intelligence Branch, and the Fusion Desk. Though the trial was initially set to cost $40,000, we did not receive documents indicating whether the MPD paid for the trial.
The MPD’s Fusion Desk — a unit charged with providing “situational awareness and operational intelligence to MPD personnel” — used Sprinklr during former President Trump’s inauguration “to monitor key terms that could have an impact on” the district, “then fed this information to” other MPD divisions to “apprise them of real-time events as they unfolded.” The list of search terms that the MPD used on Sprinklr during the inauguration focused entirely on eliciting activity surrounding anti-Trump protests, including hashtags like #DisruptJ20, #RefuseFascism, #ResistTrump, #Anticapitalist, and #Antifa.
The MPD created two other lists of search terms for Sprinklr following the inauguration. The first was a “universal list” that included the search terms “Active Shooter,” “Evacuation,” “Protests,” “Terrorism/Terrorist,” and “ISIS.” The second list was limited to activity in the DC area and used search terms about a range of criminal activity, from “Graffiti” to “Stabbing” and “Shooting.” Internal emails also indicate that the MPD was considering assembling search queries for particular events in the district. For example, one MPD employee proposed collecting information about “A Day Without Immigrants” protests in February 2017 using search terms such as #BreakLunch and #GeneralStrike. It is unclear whether the MPD ultimately used Sprinklr for this purpose.
Voyager
In December 2015, the MPD’s Intelligence Division conducted a two-week evaluation of VoyagerAnalytics, an “AI-based analysis platform” developed by a company called Voyager that collects information from social media (including Facebook, Twitter, and Instagram) and purportedly uncovers details about individuals’ “relationships, the strength of those relationships, the prominent topics and narratives important to him or her, as well as hundreds of other signals, allowing [users] to derive significant, actionable insights.” Following the evaluation, the Intelligence Division found that the tool “exceed[ed] the capabilities of all other social media investigative tools [the division] had tried.” In January 2016, Voyager provided the MPD with a pricing proposal of $37,000 to $60,000 per year for three users, though it appears the department ultimately did not move forward with the purchase.
The MPD trialed Voyager again the following year. It sought to use Voyager in January 2017 to monitor activity surrounding the presidential inauguration in a trial coinciding with its trials of Dataminr and Sprinklr. It appears the MPD ultimately began its trial with Voyager after June 2017. According to a memorandum requesting approval to use Voyager, the MPD sought to provide user licenses to criminal research specialists, members of the Criminal Intelligence Bureau, and personnel assigned to the Joint Terrorism Task Force. The memo highlights Voyager’s “integrated analytics” that allow users “to conduct network analysis and [uncover] in depth information from over six social media platforms from non-attributable proxy servers.” Though the MPD attempted to purchase three licenses for Voyager in 2017, each costing $30,000, the department ultimately did not move forward with the purchase because of the cost.
In 2019 the MPD requested another pricing proposal from Voyager as it prepared to apply for grant funding, stating that the department would request licenses for up to 25 users, including personnel from the gang unit. Though Voyager conducted a demonstration with the MPD to showcase its tool’s updated capabilities, it is unclear from the documents whether the department moved forward with purchasing licenses for Voyager.
Data Brokers
The Brennan Center and D4BL also obtained documents demonstrating that the MPD contracted or had trials with three companies — Transunion, LexisNexis, and Thomson Reuters — for data brokerage services, which included access to information from social media.
Since at least 2015, the MPD has contracted with Transunion for access to its database service, TLOxp, which contains hundreds of millions of data points of individuals’ sensitive information including social media, vehicle tracking data using license plate readers, utility data, and more. In a marketing email from May 2019, Transunion advertised TLOxp’s Social Media Comprehensive Report feature, through which users “could reveal more about a subject’s digital identity through information not readily accessible via other forms of public records data.”
According to an email thread from August 2018, TLOxp was most used by the MPD’s criminal research specialists who conduct research to support officers working in the field; it was also used for broader crime analysis and situational awareness within the department. The specialists used TLOxp to obtain information about individuals’ phone numbers, home addresses, and social media activity.
Though we obtained an email thread from April 2022 showing that the MPD was considering renewing its access to TLOxp for the 2023 fiscal year, it is unclear whether the department continues to have access to the database. However, we also obtained dozens of emails notifying MPD employees that their TLOxp accounts had been inactive for 30 days or responding to a request to reset accounts’ passwords, demonstrating that some MPD employees had TLOxp accounts until at least June 4, 2022.
We also obtained email communications indicating that MPD accessed LexisNexis’s social media monitoring services in 2014 through Accurint, the company’s flagship database. While the MPD’s Intelligence Branch held a trial of LexisNexis’s social media monitoring services in March and April 2014, a LexisNexis representative provided the MPD with a proposal to increase the department’s existing contracts for Accurint from 35 users to 50 users and to incorporate Accurint’s social media monitoring services starting in May 2014. The total cost of the contract would increase from $39,348 to $82,150 per year. Instead, the MPD opted to pay to extend the Intelligence Branch’s trial from May to at least November 2014 and did not incorporate social media monitoring features into its annual license renewal for fiscal year 2015. It is unclear whether the department eventually purchased annual licenses for LexisNexis’s social media monitoring services.
Last, we obtained email communications indicating that the MPD conducted a 14-day trial of CLEAR, the data brokerage service from Thomson Reuters, in May 2014, as well as a demonstration of CLEAR’s “Social Media Threat Tool.” However, it appears that the MPD did not move forward with purchasing access to CLEAR because officers did not find it useful. In 2020 the MPD’s Homicide Branch conducted another trial of CLEAR, after which Thomson Reuters submitted a proposal to the department that would cost between $112,100 and $450,000 annually, depending on the number of users. It is unclear whether the MPD moved forward with purchasing licenses for CLEAR.