Feminine Intelligence Agency

Tech Lead

About

The Feminine Intelligence Agency is a Northeastern University-affiliated research project investigating the intersection of clinical psychology and AI. The core research question: can large language models reliably detect psychological manipulation in real-world relationship dynamics? I joined as Tech Lead to build the evaluation infrastructure and manage the research team.

What I Do

• ·Lead a 30-student research cohort evaluating whether LLMs can detect psychological manipulation using a 28-trait UNES clinical psychology framework.
• ·Built a Python evaluation pipeline that processes 170 Reddit relationship scenarios through GPT-4o, Claude, and DeepSeek in parallel, then computes inter-rater reliability using Cohen's kappa.
• ·Key finding: models detect early-stage danger reliably (2.25 Cohen's d effect size) but fail at fine-grained manipulation classification - 19% accuracy across 17 distinct manipulator archetypes.
• ·Managed student contributors across data annotation, pipeline testing, and statistical analysis - coordinating async research work across time zones.
• ·Worked directly with FIA leadership to shape the research design and align technical output with the organization's clinical psychology framework.

Tools & Methods