Sr. Data Engineer

Position Title:

Sr. Data Engineer Location:

Charlotte, NC - must already be in charlotte Pay rate : $60/hr on C2C

Contract or Contract to Hire and expected duration : 3-6 month contract with opportunity for extension and conversion to FTE

Visa Restrictions : Must be US Citizen or Green Card Permanent Resident.

C2C candidates accepted? Yes C2C Accepted (must be eligible to convert to FTE)

Skill Requirements : General Big Data/ Hadoop concepts Strong Python/Scala Strong Spark Experience in Shell Scripting/CICD Experience with Airflow is nice to have Job Description:

Executes the development, maintenance, and enhancements of data ingestion solutions of varying complexity levels across various data sources like DBMS, File systems (structured and unstructured), APIs and Streaming on on-prem and cloud infrastructure; demonstrates strong acumen in Data Ingestion toolsets and nurtures and grows junior members in this capability Builds, tests and enhances data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity Supports the development of feature / inputs for the data models in an Agile manner; Hosts Model Via Rest APIs; ensures non-functional requirements such as logging, authentication, error capturing, and concurrency management are accounted for when model hosting Works with Data Science team to understand mathematical models and algorithms; recommends improvements to analytic methods, techniques, standards, policies and procedures Works to ensure the manipulation and administration of data and systems are secure and in accordance with enterprise governance by staying compliant with industry best practices, enterprise standards, corporate policy and department procedures; handles the manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards

Maintains the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenance issues; ensures high availability of the platform; works with Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application