Dieses Stellenangebot ist nicht mehr verfügbar
Über
Artech is currently seeking to add to the below position Job Title: Data Engineer Profiles: (Gen AI skilled ) Job ID: 26-09483 Location: Whippany, NJ Duration: 6-12 Months
Job Description: Experienced and skilled in designing, building, and maintaining high-quality data pipelines, preprocessing workflows, and vector databases required for training, fine-tuning, and deploying Large Language Models (LLMs). Build and maintain high-throughput data pipelines, infrastructure, and storage solutions specifically to feed, train, and deploy AI/ML models, implementing RAG (Retrieval-Augmented Generation) systems, data cleaning, and model evaluation to ensure efficient, scalable, and reliable LLM applications.
Required Skills & Qualifications
Strong proficiency in Python is essential, along with SQL and NoSQL for data management. Experience with LangChain, LlamaIndex, Hugging Face Transformers, and OpenAI API Experience with Apache Spark, Kafka, or modern data stack tools. Knowledge of NLP techniques, word embeddings, tokenization, and vector mathematics. Familiarity with TensorFlow, PyTorch, or Hugging Face Familiarity with cloud platforms (AWS, GCP, Azure), CI/CD, Docker, and Kubernetes. Key Responsibilities
Design and build robust ETL/ELT pipelines for unstructured text data, including scraping, cleaning, deduplication, and transformation for LLM training. Build and maintain vector search solutions (e.g., Pinecone, Milvus, Weaviate, Chroma) to store and retrieve embeddings for RAG systems. Prepare high-quality datasets for fine-tuning adapters (e.g., LoRA) and train LLMs using frameworks like PyTorch or TensorFlow. Implement Retrieval-Augmented Generation using frameworks like LangChain or LlamaIndex to connect LLMs to company data. Develop evaluation frameworks for model performance, testing for accuracy, hallucination, and bias, and monitor deployed models. Create APIs and internal web tools for data annotation, curation, and model interaction.
Please apply on our company website ( www.artechinfo.com ) with reference to job ID, or contact me at Sachin.Kumar@artech.com
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.