Within the IC, ML has the potential to disruptively advance the state of the art. Its intelligent and predictive capabilities can find insights in terabytes of data, recognize patterns in imagery, and expedite tasks that would take human analysts a significant amount of time to unveil on their own.
The rise of new technologies and sensors is causing the amount of data to grow exponentially. To support analysts, the IC needs to leverage ML to augment analyst workloads. Recent studies show, however, that out of all companies using ML, only 22% have actually deployed it in an operational capacity.
IC data scientists face several additional challenges in developing and deploying ML. Here are three of the main roadblocks:
The Clairvoyant program was originally established to address a similar set of issues—those faced by software developers in deploying software into intelligence operations.
Software development programs faced three key issues:
Together, these challenges add months to a typical deployment schedule.
In response, Clairvoyant provides a DevOps tool suite that has already significantly improved software development in the intelligence community. Booz Allen instituted:
These three capabilities made it possible for all teams—from massive, mission-critical enterprise programs to the smallest development teams—to quickly deploy new or modified programs into operations.
The agency’s second challenge set involved finding, streaming, and using data—a problem shared by both application developers and data scientists. Across the IC, data is siloed and in myriad schemas—making it hard to find and integrate data during development.
Booz Allen created an IDP to combine data warehousing, query tools, discovery tools, and streaming services in one solution, reducing barriers for developers and data scientists alike. The Clairvoyant IDP broke barriers across the enterprise by making siloed data discoverable and accessible to developers in a standardized format, making it possible to interface existing data with new, containerized applications.
This DevOps model standardized developers’ program interfaces and provided managed services for data, security, cloud infrastructure, and operational support. These services enabled developers to rapidly develop new capabilities and deploy into operations in an agile cadence.
Clairvoyant’s SageMakerSpace is a purpose-built machine learning environment that can enable the use of machine learning across the IC through MLOps. SageMakerSpace enables data scientists to leverage the power of Amazon SageMaker via a secure portal so they can collaboratively build, train, and deploy machine learning models for their mission use cases. SageMakerSpace is even more powerful when used within the Clairvoyant DevOps ecosystem, which gives users the data they need and the ability to plug-and-play ML into operations.
To make it possible to deploy ML models for use in IC missions, Booz Allen developed a MLOps approach similar to the successful solution created for software developers. The modeling environment solution provides data scientists and ML engineers with industry-standard ML modeling tools and task-ready GPU and CPU hardware, key components for delivering an ML model to operations.
When combined with the other elements of the DevOps stack (i.e., the cloud hosting framework, CI/CD pipeline, and IDP), these capabilities eliminate the most common barriers to operationalizing ML models.
This innovative approach brings the intelligence community closer to exploiting all the advantages that ML models can offer—applying the power of AI/ML to support the mission.
