We are looking for a Senior Software Engineer / Data Engineer to join our Threat Intelligence Collections team. You will design, build, and operate large-scale data collection systems that gather, enrich, and deliver high-fidelity threat intelligence from the open web, deep web, and dark web sources. This is a high-impact, technically challenging role at the intersection of cybersecurity, data engineering, and modern AI-driven automation.

You will own the full lifecycle of threat data pipelines — from raw source ingestion to clean, structured, and queryable intelligence that powers our detection, hunting, and response capabilities.

Key Responsibilities

1. 
   
2. Design and scale high-volume data collection systems that ingest threat data from open-web, deep-web, and dark-web sources (including Tor, I2P, and other anonymity networks).
3. 
   
4. Build and maintain robust, fault-tolerant data pipelines (batch + streaming) for ingestion, transformation, enrichment, and storage.
5. 
   
6. Develop advanced data parsing and normalization logic for unstructured, semi-structured, and rapidly evolving threat data formats
7. 
   
8. Design, build, and maintain agentic workflows — autonomous, LLM-powered agents that can reason, adapt, and execute multi-step collection and enrichment tasks.
9. 
   
10. Architect and operate high-scale media pipelines for ingesting, processing, storing, and enriching large volumes of media content (images, videos, screenshots, documents, etc.) collected from threat intelligence sources.
11. 
    
12. Design and build internal and external APIs that expose collected intelligence to downstream security teams and platforms.
13. 
    
14. Write clean, production-grade Python code as the primary language for all data engineering and automation work.
15. 
    
16. Collaborate closely with threat intelligence analysts, detection engineers, and security researchers to translate intel requirements into reliable, scalable data systems.
17. 
    
18. Monitor, troubleshoot, and continuously optimize collection performance, data quality, and latency at scale.
19. 
    
20. Stay current with emerging threat actor TTPs, data sources, and evasion techniques to proactively improve collection coverage.

Required Qualifications

1. 
   
2. 5+ years of experience as a Software Engineer or Data Engineer, with a strong focus on large-scale data collection and processing.
3. 
   
4. Deep experience collecting data at scale from open and dark web sources (scraping, crawling, API integration, Tor-based collection, anti-detection/anti-bot techniques).
5. 
   
6. Strong expertise in building and operating data pipelines (Airflow, Dagster, Prefect, Spark, Kafka, Flink, or equivalent).
7. 
   
8. Advanced data parsing skills — experience turning messy, unstructured web data into clean, structured intelligence.
9. 
   
10. Expert-level Python proficiency (including async, concurrency, and performance optimization).
11. 
    
12. Hands-on experience designing and implementing agentic workflows (LangChain, CrewAI, AutoGen, LlamaIndex, or similar frameworks) and integrating LLMs into production data systems.
13. 
    
14. Track record of building and maintaining production APIs (FastAPI, Flask, or similar).
15. 
    
16. Strong understanding of cybersecurity concepts and threat intelligence data types (IOCs, TTPs, malware samples, phishing kits, underground forums, etc.).
17. 
    
18. Comfortable working in a fast-paced, ambiguous environment with high-stakes data quality requirements.

Preferred Qualifications (Nice-to-Haves)

1. 
   
2. Experience with cloud platforms.
3. 
   
4. Knowledge of modern data stack tools (dbt, Snowflake, ClickHouse, DuckDB, etc.).
5. 
   
6. Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code.
7. 
   
8. Prior work in cybersecurity, threat intelligence, or intelligence collection organizations.
9. 
   
10. Contributions to open-source tools or public research in the threat intel or data collection space.

What We Offer

1. 
   
2. Competitive compensation and equity
3. 
   
4. Comprehensive health insurance (medical, dental, and vision)
5. 
   
6. 401(k) retirement plan
7. 
   
8. Unlimited PTO — take the time you need to recharge and maintain work-life balance
9. 
   
10. Generous learning & development budget for courses, conferences, books, certifications, and tools to support your continued growth
11. 
    
12. Opportunity to work on cutting-edge threat intelligence systems that directly protect organizations and people
13. 
    
14. A collaborative, high-trust engineering culture that values ownership and innovation

Are you looking for more jobs nearby? Find your favorite jobs now by visiting our online jobs page.