Back to Job Search

Senior Big Data Engineer

  • Location: Cary, 27513
  • Salary: $130000 - $140000 / year
  • Job Type:Permanent

Posted 12 months ago

This international financial services industry leader has immediate full-time needs in Cary, NC for a Senior Big Data Engineer.  This AVP level role requires working onsite at least 2 days per week in a hybrid working model. Will be part of the Origination and Advisory Technology team, which is an engineering focused organization striving for the highest quality architecture, design, and code.  This is an engineering focused organization striving for the highest quality architecture, design, and code. You will help to build Research MIS and Data analytics systems while working in a fast-paced, agile environment.  

Key requirements:
  • 4+ years of Big Data and Data Engineering experience.
  • Spark and Scala experience strongly preferred (required for the more senior level roles).
  • Hadoop and Bigdata Eco system experience strongly preferred.
  • Proficiency with NoSQL or RDBMS.
  • Experience programming in Python, Java, GoLang, or another scripting language.
  • Proficiency in Structure Query Language (SQL)
  • Experience with data structures, algorithms, and columnar Database Management System (DBMS).  ClickHouse knowledge/experience is a plus.
  • Leadership and mentoring experience preferred (required for the AVP roles)
  • Prefer experience building enterprise applications using Java, Scala, and operating systems, such as Unix.
  • Prefer experience with Apache Ecosystem, including Spark, Hive, and Hadoop.
  • Prefer knowledge of TeamCity (or similar) tool for Continuous Integration (CI) and Continuous Deployment (CD).
Responsibilities:
  • Consult on improving data reliability, efficiency, and quality.
  • Help build the Infrastructure required for optimal extraction, transformation, and data loading from a variety of data sources using batch processing
  • Ensure architecture supports business requirements.
  • Collaborate with stakeholders to understand requirements, evaluate, and refine stories.
  • Build reliable software that is easy to support in production and design, and develop high-quality and easily maintainable code.
  • Design, implement, and test solutions, providing support through the production process.