Senior Data Engineer

Key Responsibilities

• Ingestion & Pipelines: Architect batch+stream pipelines (Apache Airflow, Apache Kafka, dbt) for diverse structured and unstructured marked data. Provide reusable SDKs in Python and Go for internal data producers.
• Storage & Modeling: Implement and tune Amazon S3, column-oriented, and time-series data storage for petabyte-scale analytics; own partitioning, compression, TTL, versioning, and cost optimization.
• Tooling & Libraries: Develop internal libraries for schema management, data contracts, validation, and lineage; contribute to shared libraries and services for internal data consumers for research, backtesting, and real-time trading purposes.
• Reliability & Observability: Embed monitoring, alerting, SLAs, SLOs, and CI/CD; champion automated testing, data quality dashboards, and incident runbooks.
• Collaboration: Partner with Data Science, Quant Research, Backend, and DevOps to translate requirements into platform capabilities and evangelize best practices.

Required Skills & Experience

• 6+ years of experience building and maintaining production-grade data systems, with proven expertise in architecting and launching data lakes from scratch.
• Expert-level Python development skills (Go and C++ nice to have).
• Hands-on experience with modern orchestration tools (Apache Airflow) and streaming platforms (Apache Kafka).
• Advanced SQL skills, including complex aggregations, window functions, query optimization, and indexing.
• Experience designing high-throughput APIs (REST/gRPC) and data access libraries.
• Solid fundamentals in Linux, containerization (Docker), and cloud object storage solutions (AWS S3, GCS).
• Strong knowledge of handling diverse data formats, including structured and unstructured data, with experience optimizing storage strategies such as partitioning, compression, and cost management.
• English at C1 level - confident communication, documentation, and collaboration within an international team.
• Proven experience building robust, scalable systems for ingesting, validating, processing, and analyzing large-scale data.