Über
Allows you to work with multiple industries and learn from each of them Boosts your English by working with teams located around the world Allows you to see the direct impact of your work on the users of the solution you created… This position is for you!
In this role, you’ll get to:
Design and build automated and secure ingestion pipelines (SFTP, cloud storage, server-to-server authentication). Process large-scale datasets (terabytes) in CSV, Parquet, Excel, JSON, and custom formats. Implement high-performance transformations and processing using local analytical engines (DuckDB or equivalent). Develop extensible scripts and AI-assisted automation workflows to support new data sources. Implement data integrity validations (completeness, time coverage, file validation). Build infrastructure compatible with AWS, Azure, and/or GCP. Operate and maintain production pipelines with a focus on reliability and resilience. Respond to ingestion failures and changes in data formats. Optimize performance and reduce downtime risks in audit-time-sensitive environments. Collaborate with architects, domain specialists, and audit teams. Translate business rules into technical ingestion logic. Participate in technical conversations with clients when needed. Contribute to the system’s evolution and long-term roadmap. We are looking for you if you
Have 6+ years of experience in Data Engineering or Pipeline Engineering. Have strong proficiency in Python (or another equivalent scripting language). Have experience building ingestion systems for large, messy, and fragmented datasets. Have experience with parallelizing ingestion and processing workflows. Have knowledge and hands-on experience with DuckDB or equivalent embedded analytical engines. Have experience with SFTP, secure data transfers, and authentication mechanisms. Have experience with at least one cloud provider: AWS, Azure, or GCP. Have experience with Infrastructure as Code (Terraform or similar). Are fluent in English (direct communication with a US-based team and stakeholders) Are based in LATAM Experience with financial auditing systems, royalties, or compliance. Knowledge of the music, media, or streaming data domain. Experience working with multi-source and highly fragmented data ecosystems. Previous experience in client-facing roles. Background in DevOps or Platform Engineering. Use of AI tools applied to data engineering workflows.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.