Back to Job Search

Big Data Engineer II

  • Location: Atlanta, 30346
  • Job Type:Permanent

Posted 4 months ago

 Big Data Engineer II


LOCATIONS: Atlanta, GA - Various unanticipated long term projects throughout the US.


POSITION DESCRIPTION: Act as a hands-on developer and utilize SQOOP and FTP for data ingestion from various data sources. Responsible for data validation of structured and unstructured data sources in Hadoop. Process Big Data using Apache PIG. Interact with Hadoop File system commands (HDFS) on Linux Shell to process Big Data files. Automate batch jobs using Shell scripts. Write custom Java UDF's for Pig and Hive to meet business requirements. Validate data on Hadoop Platform. Write SQL queries against Oracle and MySQL Databases. Perform defect tracking and bug reporting, and analyze the production defects.

REQUIREMENTS: Bachelor’s or Master’s degree in Information Technology, Computer Science, Computer Engineering, or related degree. Foreign equivalents accepted.

5 years progressive, post-Bachelor’s experience (or 2 years with Master’s degree) as a Lead Software Developer, or related software developer occupation.

SPECIAL REQUIREMENTS: Experience is required which must include some experience with: Design and develop big data solutions for end clients; Hadoop, pig, hive, and java; Full life cycle development of software application in big data platform; and Test and productionize jobs and assist end users in UAT.

Candidates will be responsible for following the client's COVID-19 protocols. Please refer to your MATRIX representative for specifics.

About Us

At MATRIX, we expertly match talented professionals with job opportunities to elevate careers. Since 1983, we have placed thousands of professionals at innovative clients across every industry ranging from small startups to Fortune 50 companies. It’s why we’re consistently in the top 25 of all U.S. IT staffing firms and why our consultants rate us well above the industry average, earning us ClearlyRated's Best of Staffing awards year after year. People come to us for a job, and stay with us because of our top-notch consultant care.

MATRIX is and Equal Employment Opportunity employer including disability and veteran and provides reasonable accommodations for all qualified individuals.  Supporting medical or religious documentation will be required where applicable. If you are a qualified individual you may request a reasonable accommodation under the American Disability Act (ADA). If you are a person with a disability needing assistance applying, or at any point in the hiring process, please email us at To ensure a quick response to your request, please use the words “Accommodation request” as the subject line of your email.

For hourly W2 contract roles MATRIX offers a highly competitive benefit package including Medical, Dental, Vision, Life, Disability, HSA, and 401(k) with pre and post-tax options.  Please see for more information.

For direct hire placement with our clients, benefits would be offered in accordance with that particular client’s offerings. This may include PTO, Medical, Dental, Vision, 401K and other pre and post-tax options.