Back to Job Search

Big Data Developer

  • Location: Tampa, 33610
  • Job Type:Contract

Posted 8 days ago

Grow your career as a Big Data Developer with an innovative global bank in Tampa, FL. Long-term contract with excellent growth potential. Will be required to be onsite 3 days per week. Will work on the collecting, storing, processing, and analyzing of huge sets of data. Will primarily focus on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. Will also be responsible for collaborating with different stakeholders/team for required development.
 
Responsibilities:
  • Implement ETL process using defined framework.
  • Monitor performance and advise any necessary infrastructure changes.
  • Create/modify tables, views in hive.
  • Write Shell Scripts to execute hive on spark jobs.
  • Automate the Shell Scripts on job scheduling tool - Autosys.
  • Improve job performance by implementing hive parameters, spark configuration level changes and spark optimization techniques.
  • Create/modify HQL script to retrieve data from hive tables or to use HQL script for data processing.
  • Work with team to defining data retention logic as per business requirements.
  • Perform and oversee tasks such as writing scripts, writing T-SQL queries and calling APIs.
  • Customize and oversee integration tools, warehouses, databases, and analytical systems.
  • Design the data flow, create data flow diagrams and implement design level changes.
  • Design and implement data stores that support the scalable processing and storage of the high-frequency data.
  • With the help of Admin/Support team, solve any ongoing issues with operating the cluster.
 
Qualifications:
  • Bachelor’s or Master’s degree in Computer/Data Science Technical is required.
  • 7+ years of hands-on years of data engineering experience with data warehouse, data lake, and enterprise big data platforms required.
  • 2+ years of experience with real-time data stream platforms such as Flume, Kafka and Spark Streaming.
  • Experience working in an Agile/Iterative methodology required.
  • Working experience with Bigdata-Hadoop ecosystem: NoSQL-Hive, Impala, Spark, Scala, shell scripting and RDMBS-MS SQL server required.
  • Experience with integration of data from multiple data sources with full load, incremental load and real time load.
  • Working experience with development/deployment tool: Jira, Bitbucket, Jenkins, RLM.
  • Experience with Spark ,Hadoop v2, MapReduce, HDFS required.
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala required.
  • Experience with various ETL techniques and frameworks required.
 
About our client
 
Our client stands as one of the worlds most renowned global banks and trusted brand with over 200 years of continuously evolving financial services. Its teams provide unique insights to more than 200 million clients and enable progress all over the world. While growing your career, you will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.

​

Candidates will be responsible for following the client's COVID-19 protocols. Please refer to your MATRIX representative for specifics.

About Us

At MATRIX, we expertly match talented professionals with job opportunities to elevate careers. Since 1983, we have placed thousands of professionals at innovative clients across every industry ranging from small startups to Fortune 50 companies. It’s why we’re consistently in the top 25 of all U.S. IT staffing firms and why our consultants rate us well above the industry average, earning us ClearlyRated's Best of Staffing awards year after year. People come to us for a job, and stay with us because of our top-notch consultant care.

MATRIX is and Equal Employment Opportunity employer including disability and veteran and provides reasonable accommodations for all qualified individuals.  Supporting medical or religious documentation will be required where applicable. If you are a qualified individual you may request a reasonable accommodation under the American Disability Act (ADA). If you are a person with a disability needing assistance applying, or at any point in the hiring process, please email us at MATRIX_HR@MatrixRes.com. To ensure a quick response to your request, please use the words “Accommodation request” as the subject line of your email.