This job offer is no longer available
About
Charlotte, NC Onsite
We are seeking a
Python-based platform engineer
to design and build a containerized
API layer
that abstracts and governs interactions with engines such as
Apache Spark
through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools enabling consistent, secure, and scalable access to Spark and non-Spark based data pipelines.
The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems, packaging services using containers ( Docker/Kubernetes ), and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required, along with solid software engineering practices around testing, versioning, and deployment.
This role is suited for engineers who have built data or compute platforms, service layers, or internal frameworks translating complex data pipeline capabilities into stable, contract-driven APIs for broad enterprise use.
Tech Skills
" Experience building control planes
" Design patterns
o Modular containerized services
o Asynchronous processing
o Job-based work queue execution
o Immutability and idempotency
o Metadata management
o Policy enforcement
o Semantic modeling
o Observability and telemetry
o Side effect capability injection
Testing
" Functional testing
" Behavioral testing
Languages
"
Python
Frameworks and Platforms
" FastAPI
" ARQ
" Kubernetes
" Pytest
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.