This job offer is no longer available
About
I have an opportunity for "Data Analyst and looking for a candidate who can join Immediately if you are interested reply me with your updated resume or consultant's contact details and if you could refer someone i really appreciate it.
Job Title : Data Analyst - New York, NY
Location : New York, NY
Duration : 12 months
Only ON W2
No C2C
Job Description :
There are 2 data platforms; an older one being deprecated and a new one.
Each has its own domain-specific methodology and format for how data pipelines are supposed to be built and executed.
Both represent ETL mechanisms that connect into raw Capital One data streams, extract data, perform transformations, then are loaded into a OneLake/S3 bucket on AWS.
One is being deprecated in favor of the other.
Looking to have someone who fits the profile of either a Data Analyst or a Data Engineer refactor the ETL pipelines from one system into the next one.
Need people who are able to work independently and with ease in the languages.
Comfortable working in GitHub and collaborative repos; ideally, be able to work with command line tools, run Bash settings, SSH into remote instances.
Most of the work is using cloud infrastructure; comfortable launching and running Spark jobs on MapReduce type clusters (on AWS, this would be EMR.) Must be comfortable reading unstructured data formats. Understand CloudFormation templates on AWS.
This is more technical-oriented DA job - might be closer to a DE. Comfort working with data using standardized tools for working with large data.
Would almost have to be a Big Data Engineer; working with large amounts of data, most of the computation is done across clusters of servers.
Tech Skills Required: SQL, Spark (Pyspark primarily), Python, AWS (EMR primarily)
Best Regards
Chris Brown
Sr Technical Recruiter
NAVTECH INC
PH : 224-296-3522
Email : chris@navtechusa.com
Fax: 847-565-8208 URL: www.navtechusa.com
E-Verified Company
Corporate Center
1600 Golf Road. Suite 1200, Rolling Meadows, IL 60008
Disclaimer: We respect your Online Privacy. This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are not interested in receiving our emails then please reply with a "REMOVE" in the subject line and mention all the email addresses to be removed with any email addresses, which might be diverting the emails to you. We are sorry for the inconvenience.
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.