Back to Job Search

Senior Big Data Engineer

  • Location: Cary, 27513
  • Salary: 130000.0
  • Job Type:Permanent

Posted 2 months ago

This international financial services industry leader has immediate full-time needs in Cary, NC for Senior Big Data Engineers.  Requires working onsite at least 2 days per week in a hybrid working model.  This is an engineering focused organization striving for the highest quality architecture, design, and code. You will help to build  Research MIS and Data analytics systems while working in a fast-paced, agile environment.

Responsibilities:

  • Consult on improving data reliability, efficiency, and quality.
  • Ensure architecture supports business requirements.
  • Collaborate with stakeholders to understand requirements, evaluate, and refine stories.
  • Build reliable software that is easy to support in production and design, and develop high-quality and easily maintainable code.
  • Design, implement, and test solutions, providing support through the production process.

Requirements:

  • Proficiency in Python, Scala, and Spark.
  • Experience building enterprise applications using Java, Scala, and operating systems, such as Unix.
  • Proficiency in SQL.
  • Experience with Apache Ecosystem, including Spark, Python, Hive, and Hadoop strongly preferred.
  • Knowledge of TeamCity (or similar) tool for Continuous Integration (CI) and Continuous Deployment (CD).
  • Experience with data structures, algorithms, and columnar Database Management System (DBMS), preferably ClickHouse.
  • Google Cloud Platform (GCP) experience preferred.