Data Infrastructure Engineer
Alljoined
- San Francisco, California, United States
- San Francisco, California, United States
About
We are actively growing our founding engineering team to build the underlying infrastructure that makes this ambitious future a reality.
About the Role As a Data Infrastructure Engineer , you will build the backend and hardware architecture that allows us to do high‑quality and fast research. You'll be owning our entire data lifecycle, from building pipelines that process massive multimodal datasets (video, audio, text, time‑series) to provisioning and managing both cloud and bare‑metal compute clusters we use to train on it. You will be powering our foundational model training by bridging the gap between physical neuro hardware and our central repositories, working alongside world‑class researchers to ensure they have a high‑throughput, low‑latency pipeline straight to the GPUs.
You might be a good fit if you
Have 3+ years of production software engineering experience with deep expertise in systems‑level architecture and languages like Python, Rust, C++, or Go.
Have built and maintained high‑performance ETL pipelines capable of processing, buffering, and storing terabytes of daily unstructured data.
Are comfortable architecting, provisioning, and maintaining bare‑metal local compute clusters, storage servers, and high‑speed networking for intensive ML workloads.
Have a background in handling continuous, highly concurrent data streams from heterogeneous hardware peripherals without data loss.
Are capable of working across hybrid environments to define storage topologies, manage databases (TimescaleDB, ClickHouse), and sync massive datasets between on‑premise edge servers and the cloud (AWS/GCP/Azure).
Enjoy owning the entire technical lifecycle of infrastructure, from optimizing low‑level I/O bound operations to production deployment.
Strong candidates may have
A deep understanding of modern ML frameworks (PyTorch/TensorFlow) and know how to build datasets that maximize and saturate GPU utilization.
Experience managing networking for distributed GPU training (InfiniBand, RoCE) or optimizing zero‑copy networking and shared memory.
Built infrastructure involving programmatic video processing (FFmpeg, GStreamer, OpenCV)
Compensation Range $140,000 - $180,000/year
While this represents our expected range based on market data, final compensation will be determined based on your specific skills and experience and may be outside this range.
Benefits
Competitive equity compensation at a seed stage startup
Options for housing support
Visa sponsorship
3% 401k matching
Health insurance
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.