Back to Job Search

Lead Big Data Engineer

  • Location: Plano, 75024
  • Job Type:Contract

Posted 13 days ago

Long term contract in Plano, TX for a Lead Big Data Engineer.
 
Responsibilities:
  • Design and develop high performing, scalable big data solutions in AWS and GCP to support advanced analytical use cases.
  • Develop data pipelines for optimal extraction, transformation, and loading (ELT, ETL) from a wide variety of data sources using Big Data and Integration technologies.
  • Design & develop feature, and code reviews to drive excellence in engineering and ensure high quality & maintainability.
  • Implement effective solutions for cleansing & data quality, lineage.
  • Support improvement of platform features for high productivity and availability.
 
Qualifications:
  • Bachelor’s degree in Information Systems, Computer Science, or related discipline. Master’s degree in Computer Science or related discipline is preferred.
  • 4 years of experience in developing big data solutions that support business analytics and data science teams.
  • 7 or more years of proficient experience developing data platforms, data warehouses, ETL/ELT pipelines and programming in SQL, Python, Java, Scala-Spark, Bash, and other scripting languages.
  • Strong knowledge and hands on experience in Big Data technologies in Cloud such as AWS EMR, Apache Spark, Databricks, AWS Redshift, Snowflake, S3, GCP Big Query, Google Cloud Storage and Google Data Proc.
  • Proven experience designing various batch & real-time streaming ingestion patterns with Sqoop, Kafka, Kinesis, GCP Pub/Sub.
  • Proven leadership in cloud administration with emphasis on infrastructure automation (Terraform, Cloud Formation) and provisioning Lambda, SNS, EC2, Airflow, Elastic Cache, Redis, RESTful APIs in AWS.
  • Knowledge of DevOps methodology and automation experience with Jenkins, Ansible, Chef, XL Release and XL Deploy.
  • Prefer AWS/GCP Cloud certifications.
  • Prefer AWS/GCP Data Engineering certifications.
  • Prefer experience with automobile and/or manufacturing organizations.

​

Candidates will be responsible for following the client's COVID-19 protocols. Please refer to your MATRIX representative for specifics.

About Us

At MATRIX, we expertly match talented professionals with job opportunities to elevate careers. Since 1983, we have placed thousands of professionals at innovative clients across every industry ranging from small startups to Fortune 50 companies. It’s why we’re consistently in the top 25 of all U.S. IT staffing firms and why our consultants rate us well above the industry average, earning us ClearlyRated's Best of Staffing awards year after year. People come to us for a job, and stay with us because of our top-notch consultant care.

MATRIX is and Equal Employment Opportunity employer including disability and veteran and provides reasonable accommodations for all qualified individuals.  Supporting medical or religious documentation will be required where applicable. If you are a qualified individual you may request a reasonable accommodation under the American Disability Act (ADA). If you are a person with a disability needing assistance applying, or at any point in the hiring process, please email us at MATRIX_HR@MatrixRes.com. To ensure a quick response to your request, please use the words “Accommodation request” as the subject line of your email.