S'INSCRIRE

Offres d'emploi

Trouvez des postes près de chez vous, sur site, hybrides ou à distance.
  • Emplois similaires à : Data Engineer and Architect
XX
Data Engineer Architect (TX)Diverse Lynx • United States
Postuler Maintenant
XX

Data Engineer Architect (TX)

Diverse Lynx
  • US
    United States
  • US
    United States
Postuler Maintenant

À propos

Data Engineer Architect
Looking for a data professional with expertise in data engineering, programming and architect to build systems that collect, manage, and convert raw data into usable information for business requirements. As a Data Engineer architect, you'll play a crucial role in ensuring data reliability, quality, and efficiency within the organization. Responsibilities
Analyse and organize raw data: Work with various data sources, document parsing, extracting relevant information and structuring it for further processing. Build data systems and pipelines: Construct robust data pipelines that facilitate data flow from source to Target. Evaluate business needs and objectives: Understand the company's requirements and align data systems accordingly. Interpret trends and patterns: Use your analytical skills to identify data patterns. Conduct complex data analysis and report on results: Dive deep into data to extract meaningful information. Prepare data for prescriptive and predictive modelling: Ensure data is ready for machine learning and statistical analysis. Build algorithms and prototypes: Develop and test data processing algorithms. Combine raw information from different sources: Integrate data from various systems. Explore ways to enhance data quality and reliability: Continuously improve data processes. Identify opportunities for data acquisition: Stay informed about new data sources. Develop analytical tools and programs: Create tools to facilitate data analysis. Collaborate with data scientists and architects: Work closely with other data professionals to achieve common goals. Implement data access controls, data encryption, and data masking techniques Familiarity with data visualization tools and techniques for presenting data Create and maintain dashboards and reports for stakeholders. Mandatory Skills
15+ years in Data Engineering / Data Architecture Good knowledge of programming languages (e.g., Python, Java, Spark, etc). Design, develop, and maintain data pipelines. Exposure to process automation. Experience working with REST APIs and services, messaging and event technologies. Experience working with large and complex data sets. Hands-on experience with SQL/No-SQL database (RDS, Redshift, DynamoDB, synapse, big query, mongo, etc.) Batch/stream data processing experience Monitor, troubleshoot, and optimize the performance of data infrastructure to ensure scalability, reliability, and cost efficiency. Stay up to date with cloud services and best practices in data engineering to continuously improve our data ecosystem. Good exposure on at least two public cloud platforms (Azure/AWS/GCP) Experience with Graph database (e.g. Neptune, RDF4j, etc.) Experience with Vector database (e.g. Pinecone, FAISS, etc.) Hands-on experience with ETL/ELT tools (Informatica, Talend, dbt, etc.) - Expertise in cloud platforms: AWS / Azure / GCP - Experience with big data technologies: Spark, Hadoop, Kafka - Strong knowledge of data warehousing (Snowflake, Redshift, BigQuery) - Experience in building real-time and batch data pipelines - Strong understanding of data governance and security frameworks - Experience with CI/CD, DevOps practices for data pipelines - Proven leadership and stakeholder management skills Good-to-Have Skills
Knowledge or work experience in insurance, mortgage, banking domains. Proficiency in building stream processing systems using kinesis, Kafka, etc. Familiarity with Docker, Kubernetes, CI/CD and cloud services (AWS, Azure, GCP). Technical expertise with segmentation techniques. NLP knowledge Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • United States

Compétences linguistiques

  • English
Avis aux utilisateurs

Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.

10'000+ offres d'emploi : Trouvez des postes près de chez vous, sur site, hybrides ou à distance