“First, we did initial exploration of the 8 years of data,” says team leader Paul Yacci. “Then we applied LDA, a topic modeling algorithm that extracts trends from free text.” Amanda Beierl, an expert in military issues, labeled the topics that LDA extracted to identify meaningful topics. “Artificial intelligence allowed us to distill the ideas contained in a respondent’s answer, without having to read every topic. This allowed us to look quickly across trends,” Paul said.
The qualitative data amplified the qualitative answers. For example, while the quantitative analysis showed 66 percent of respondents would recommend military service, the qualitative data showed that these participants were likely to have more than five immediate family members in the military.
Talking with BSF as the project progressed, Paul discovered the data had never been analyzed geospatially, so he added that to the project. “Summarizing the survey results by geographic region allowed us to see if concern over an issue is different in New York and Texas, for example.”
Laura explains the benefit: “If military families in a state say that child care is their biggest challenge, BSF can share that with area leaders. DoD could increase its capacity in that area, or the local government could encourage more child care businesses to open.”
Delivering the Results
Paul and BSF presented the results in January to the Bipartisan Policy Center, a nonprofit that seeks promising ideas to solve pressing problems. In March, he also spoke at the Defense Community Leadership Academy (DCLA), a grassroots training program designed by BSF and the Association of Defense Communities and sponsored by Booz Allen.
Now Booz Allen is looking ahead to the tenth year anniversary of the survey, envisioning deeper data work such as a trend analysis across the decade. “I’ve worked on a lot of projects for social good. It’s rewarding to uncover the findings and get them to people who can make a real impact,” Paul says. “Military families go through so much to serve their country—it’s great to give them a voice.”