Josh Hirschkorn
--:--:--
All roles

Jul 2026 · Present · London

Quantitative Developer Intern

Cantor Fitzgerald & BGC Group logo

Cantor Fitzgerald & BGC Group

  • Python
  • Apache Airflow
  • Nomad
  • Solace
  • Linux

Working on infrastructure that watches production job orchestration and messaging health, so problems surface on their own rather than waiting to be noticed.

Monitoring pipeline for Nomad jobs

I designed and deployed a scalable Apache Airflow DAG that orchestrates a monitoring pipeline across Nomad jobs. The pipeline analyses Solace queue health automatically and generates outage reports from what it finds, which cut mean time to detection by 95%.

The work sits at the intersection of scheduling, message-broker internals and reporting: the DAG has to be reliable enough that its own failures are visible, and the analysis has to distinguish a genuinely unhealthy queue from normal load.