data
Posted May 11Senior Data Engineer
at Alpaca
North America Latam, United StatesRemote
Responsibilities
- Design and oversee key forward- and reverse-ETL patterns to deliver data to relevant stakeholders.
- Develop scalable patterns in the transformation layer to ensure repeatable integrations with BI tools across various business verticals.
- Expand and maintain the Alpaca Data Lakehouse architecture's constantly evolving elements.
- Collaborate closely with sales, marketing, product, and operations teams to address key data flow needs.
Requirements
- We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.
- We prioritize open-source solutions in our data management approach, leveraging a Google Cloud Platform (GCP) foundation for our data infrastructure.
- experience in data engineering, including 2+ years of building scalable, low-latency data platforms capable of handling >100M events/day.
- Proficiency in at least one programming language, with strong working knowledge of Python and SQL. •
- Experience with cloud-native technologies like Docker, Kubernetes, and Helm. Strong hands-on
- experience with relational database systems and object storage implementations like Apache Iceberg. Strong hands-on
- experience with Google Cloud Platform and its various data-related services (Composer, Dataproc, Datastream, etc.) •
- Experience in building scalable transformation layers, preferably through formalized SQL models (e.g., dbt).
- Ability to work in a fast-paced environment and adapt solutions to changing business needs. •
- Experience with ETL orchestrators / frameworks like Apache Airflow and Airbyte. Production
- experience with streaming systems like Kafka.
- Deep knowledge of distributed systems, storage, transactions, and query processing utilizing open-source distributed query engines like Trino (formerly PrestoSQL).
Benefits
- Our recent Series D funding round brought our total investment to over $320 million, fueling our ambitious vision.