DoD JAIC T&E BPA

About JAIC DRAID

Technica Corporation has been selected as a prime awardee of the Department of Defense (DoD) Joint Artificial Intelligence Center (JAIC) Test and Evaluation (T&E) Blanket Purchase agreement. This decentralized vehicle provides access for all of DoD to rapidly procure new and innovative AI test tools, capabilities, and services. The BPA will also support the Joint Common Foundation as the central platform for tailored, extensible T&E, curation of training and validation data, and identification of best metrics to characterize performance.  Agencies and organization within the DoD and US Government are able to order specific T&E services to include, but not limited to:

• Data Set Development/Curation/Documentation: Each MI or Government AI project has unique data that must be acquired and curated such that it can be used to test modern AI software systems. Efforts include, but are not limited to, data provenance, integrity, security, quality assessment, image annotation, and data coverage analysis as applied to T&E in addition to data documentation and corresponding review.
• Test Harness Development: Creation of automated, containerized, cloud[1]enabled test harnesses that facilitate automatic ingestion of data into a containerized AI model and aggregates the results.
• Model Output Analysis: Analysis expertise/software is needed to assess the quality of results from the AI models developed by the MIs. This effort involves both development of containerized, cloud-based, analysis software and creation of context specific and operationally relevant performance metrics.
• Test Planning, Documentation, and Reporting: Testing expertise to create the required documentation for an AI algorithm undergoing the testing lifecycle (algorithm test, system test, and operational test). This effort includes, but is not limited to, the creation of Test and Evaluation Master Plans (TEMPs), Test Plans, and Test Reports, and management of a test schedule.
• Testing Services: This effort involves the services and expertise to plan, document, and conduct T&E of AI, automated, and autonomous products. This includes, but is not limited to, performing testing on AI algorithms and/or AI enabled systems across all T&E areas (algorithm test, system test, developmental test, and operational test).
• Identifying new technologies, products, or development efforts: AI is a new and rapidly developing field. The JAIC T&E Division is tasked with finding those technologies not covered within the scope of the previous focus areas that may be beneficial to AI T&E efforts at the JAIC. The JAIC T&E Division identifies the impact of the new technologies and incorporates the effort to improve T&E of AI.
• All proposed solutions must align with JCF and Mission Initiative infrastructure needs, i.e., cloud-based test tools that are containerized and should be designed and developed in a responsible manner such as outlined in the Department of Defense AI Ethical Principles, adopted February 2020 (“DoD AI Ethical Principles”).