Big Data Engineer II
LOCATIONS: Atlanta, GA - Various unanticipated long term projects throughout the US.
POSITION DESCRIPTION: Act as a hands-on developer and utilize SQOOP and FTP for data ingestion from various data sources. Responsible for data validation of structured and unstructured data sources in Hadoop. Process Big Data using Apache PIG. Interact with Hadoop File system commands (HDFS) on Linux Shell to process Big Data files. Automate batch jobs using Shell scripts. Write custom Java UDF's for Pig and Hive to meet business requirements. Validate data on Hadoop Platform. Write SQL queries against Oracle and MySQL Databases. Perform defect tracking and bug reporting, and analyze the production defects.
REQUIREMENTS: Bachelor’s or Master’s degree in Information Technology, Computer Science, Computer Engineering, or related degree. Foreign equivalents accepted.
5 years progressive, post-Bachelor’s experience (or 2 years with Master’s degree) as a Lead Software Developer, or related software developer occupation.
SPECIAL REQUIREMENTS: Experience is required which must include some experience with: Design and develop big data solutions for end clients; Hadoop, pig, hive, and java; Full life cycle development of software application in big data platform; and Test and productionize jobs and assist end users in UAT.