Staff Data Engineer
Visa
- San Mateo, California, United States
- San Mateo, California, United States
À propos
Design, build, and optimize large-scale data pipelines for batch and real-time processing
Develop and maintain distributed data systems that are highly available, scalable, and resilient
Lead initiatives to process, transform, and manage structured and unstructured data across platforms
Drive development of data platforms and data products that support analytics, reporting, and machine learning use cases
Partner with product, analytics, and business teams to translate requirements into scalable data solutions
Architect solutions using big data technologies such as Hadoop, Spark, and distributed data processing framework
Build and optimize ETL/ELT pipelines and ensure high data quality, reliability, and performance
Implement automation, monitoring, and observability for data pipelines across the data lifecycle
Lead proof-of-concept initiatives to evaluate and adopt new data engineering technologies
Influence and drive best practices in data engineering, including data modeling, pipeline design, and governance
Mentor engineers and foster a culture of continuous learning and accountability.
Essential Functions: Collaborate with stakeholders to understand data requirements and deliver impactful solutions Architect and implement secure, robust, and scalable data platforms Drive innovation through experimentation, prototyping, and rapid iteration Ensure strong data governance, quality, and operational excellence Engage with cross-functional teams to align on technical and business outcomes This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager. Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager. Qualifications Basic Qualifications * 5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD. Preferred Qualifications * 6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD * Demonstrated leadership in delivering high-quality, large-scale, enterprise-class applications. * Solid experience in big data engineering, with knowledge of Hadoop, Apache Spark, Python, and SQL. * Expertise in Java or Scala and container-based technologies (Docker, Kubernetes). * Proficiency in creating and managing large-scale data pipelines and machine learning models. * Experience developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. * Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services. * Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M. * Familiarity with Agile development, TDD, CI/CD, and various databases. * Proven track record of building reliable, scalable, and operable applications. * Ability to manage component security analysis and collaborate with security teams. * Strong work ethic, focus on immediate goals, and proven experience as a technical leader. * Passion for mentoring and helping juniors grow professionally. * Excellent communication and interpersonal skills, and a strong team player. U.S. Applicants Only The estimated salary range for this positionis $146,200.00 to $ 233,700.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program. Work Hours Varies upon the needs of the department. Travel Requirements This position requires travel 5-10% of the time. Mental/Physical Requirements This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers. Visa is an EEO Employer Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.