דרוש/ה Senior Data Engineer - Real-Time & Streaming

תיאור המשרה

Senior Data Engineer – Real-Time & Streaming

About the Company:
A leading Israeli Defense-Tech company developing advanced technology for autonomous systems and low-altitude airspace management. The company operates in complex, mission-critical environments in Israel and internationally.

About the Role:
The company is developing next-generation autonomous UAV swarm C2 and AI-driven airspace management systems. We are looking for a Senior Data Engineer to design and build our core real-time data infrastructure.

In this role, you will lead the architecture of high-throughput streaming pipelines and lakehouse solutions that process live telemetry, spatial coordination data, and AI/game-theoretic decision streams from 200+ autonomous drones in contested environments.

Responsibilities:
Data Infrastructure & Architecture: Design, build, and maintain scalable, low-latency data pipelines handling millions of real-time spatial messages daily.
Streaming & Lakehouse: Implement distributed streaming frameworks and data warehouse/lakehouse schemas to support both real-time C2 execution and post-mission analytics.
Full-Lifecycle Ownership: Take end-to-end ownership from system architecture, data modeling, and IaC deployment to monitoring, optimization, and security.
Cross-Functional Collaboration: Partner closely with R&D, AI/Algorithm engineers, and product teams to integrate game-theoretic COA models and simulation telemetry.
Performance & Scale: Optimize system throughput, memory footprints, and cloud infrastructure costs to support mission-critical, low-latency deployments.

Requirements:
Experience: 6+ years of experience building production data/backend systems in Python or Java/Spring.
Real-Time & Streaming: 3+ years of hands-on experience with streaming platforms (Kafka, RabbitMQ, AWS Kinesis) and near real-time data processing (~10M+ messages/day).
Data Modeling & Storage: Deep proficiency in SQL and NoSQL databases (e.g., PostgreSQL, Elastic, DynamoDB, Redis) and schema design for high-concurrency systems.
Cloud & DevOps: Strong experience with AWS cloud infrastructure, containerization (Docker, Kubernetes), CI/CD, and Infrastructure as Code (Terraform/AWS CDK).
System Design: Solid understanding of microservices architecture, distributed systems, and distributed state management.
Education & Soft Skills: B.Sc. in Computer Science, Software Engineering, or equivalent; excellent problem-solving skills and a proactive, "get-things-done" approach.
Security Clearance: Active Israeli security clearance at Level 3 or higher (more stringent) is mandatory.

Advantages:
Geo-Spatial Data: Experience with spatial data modeling, GIS tools, or spatial indexing frameworks (e.g., PostGIS, H3, GeoJSON).
Big Data & Lakehouse: Hands-on experience with Databricks, Spark, Delta Lake, Snowflake, or ClickHouse.
Regulated Industries: Prior work in defense, aerospace, aviation, or compliance-heavy environments (ITAR, CMMC, FedRAMP).

Why Join?
Real Impact: Your code will protect infrastructure and help manage complex airspace environments.
Elite Team: Work alongside experienced defense professionals and top-tier engineers in a mission-driven environment.
Forward-Thinking: AI tools are not just encouraged - engineers are expected to leverage them as part of their work.