Back to Job Search

Azure Data Engineer

  • Location: Deerfield Beach, 33442
  • Job Type:Permanent

Posted 10 days ago

Position: Azure Data Engineer
Location: Deerfield Beach, Florida
Term: Direct-hire 

Responsibilities 
  • Work as part of a team to develop Cloud Data and Analytics solutions
  • Participate in development of cloud data warehouses, data as a service, business intelligence solutions
  • Ability to provide solutions that are forward-thinking in data and analytics
  • Deliver a quality product
  • Coding complex Spark (Python), T-SQL
  • Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse)
  • Enterprise level application design, engineering and development using .NET Core, C#, and Azure PaaS
  • Enterprise level application design, engineering and development for Azure Data Lake and related technologies
  • Implement core REST + JSON based APIs
  • Accountable for escalating issues and risks through the Tech Lead / Delivery Architect
  • Responsible for executing on tasks as directed by the Tech Lead / Delivery Architect
  • Responsible for communication and raising awareness to the Tech Lead / Delivery Architect concerning issues, risks or other items that may impede development tasks
  • Responsible for understanding and ensuring development standards are followed through code quality reviews and compliance scans
  • Work with team members to properly define/clarify business requirements, development estimation, and work plan finalization
  • Perform unit and integration testing on all developed code – Create and execute unit and integration tests within development lifecycle
  • Participate in / lead implementation and support transition of completed components
  • Assists / responsible for task identification
  • Responsible for understanding of functional and technical requirements
  • Participate / lead design discussions
  • Assist other teams with troubleshooting problems that may arise from applications or integration of various components.
  • Support and Troubleshooting – Assist Operations Team with any environment issues during application deployment across Development, QA, Staging, and Production environments.
  • Leading and working closely alongside other developers and QA engineers throughout the software development lifecycle
  • Work in a dynamic, changing environment using continuous integration
  • Provide technical and functional support for Microsoft Dynamics Finance and Operations in production and non-production environments (plus)
  • Customize and develop different modules including AR, AP, GL, Inventory Management, Cost Accounting, Warehouse Management, Procurement and Sourcing modules (plus)
Requirements
  • Hands-on experience in Azure Databricks, Azure Data Factory, Azure Synapse – Mandatory
  • Good understanding of Azure Databricks platform and ability to build data analytics solutions to support the required performance & scale
  • Working with Spark cluster and effective usage of spark engine for any data transformation creating notebooks with PySql scripts
  • Ability to Read and Write data to Azure Data Lake or Blob storage from Databricks
  • Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks building Data Pipelines for File, Database and API based ingestion using different activities within and also with Data flows for any Data Transformation
  • Good Knowledge on Global parameters, Triggers, Linked services, Datasets and Arm template
  • Experience of creating tables, building dimensional modelling
  • Experience as Data Engineer in Azure Big Data Environment
  • Expertise in ETL tools i.e. (SSIS)
  • Expertise in Implementing Data Warehousing Solutions
  • Experience with working in Agile ( Scrum) environment as part of a scrum team
  • Programming experience in Python, T-SQL
  • Hands-on experience in Azure stack, with good knowledge on Azure Key Vault, Active directory and basic understanding of Devops and SSIS
Qualifications and Skills
  • 2+ years with Azure Data Lake technologies, specifically with Spark, Synapse, Parquet, and ADLS storage
  • 2+ years with Azure Functions, Service Bus and Event Hub
  • Ideal candidate has experience with Azure Analysis Services
  • Ideal candidate has experience with Power Platform (Power Automate and Power BI)
  • 2+ years PaaS implementation experience in Azure
  • 2+ years Web Apps, API Mgmt, Logic App, Function, Service Bus experience
  • 2+ years SQL Azure, Azure Tables, Cosmos
  • 7+ years of hands-on-experience delivering solutions related to enterprise integration, APIs, service-oriented architecture
  • 5+ years of in-depth development experience with C#/.NET
  • 5+ years Microsoft SQL Server experience (Configuration, Administration and Tuning)
  • 5+ years PowerShell experience (JSON, XML, other scripting an asset)
  • 5+ years Visual Studio with Continuous Integration
  • 2+ years Infrastructure as code
  • 3+ years performing object-oriented design and building backend applications with REST API services
  • 2+ years of UI development experience working with UI/UX Designers
  • 2+ years of experience working in Agile product team environment.
  • 1+ years of development experience working with Messaging platforms (IBM MQ, MSMQ etc)
  • 1+ years of experience leading efforts in support of solutions using technologies such as PowerApps, Power BI, Power Automate, and SharePoint
  • 1+ years of development / implementation experience with MS D365, D365 F&O, and X++ are a plus
  • Demonstrable understanding of Web Services (SOAP, REST), XML and JSON formats document schemas, HTTP protocol, and underlying internetworking concepts
  • Strong knowledge of EAI SOA best practices, development methodologies standards
  • Experience working on complex state machines
  • Experience with Javascript frameworks (React is a plus)
  • Experience orchestrating complex use cases involving multiple systems, incorporating error handling and logging
  • Excellent troubleshooting skills with the ability to analyze and resolve complex technical issues and defects
  • Experience in Continuous Integration and Continuous Deployment using Azure DevOps (Maven, Jenkins, Git, and or comparable toolsets a plus)
  • MCSE or other Microsoft certifications and Azure Certifications a plus
  • Hands on experience with AWS / AWS certification a plus
Technologies
  • Microsoft: ASP.NET Core, Azure, C#/Web API
  • Experience with Azure (EventHub/ServiceBus, Function Apps, Logic Apps etc), .NET Core, RESTful services, AWS, Power Apps
  • Web: Azure Web Apps, HTML, HTML5, Javascript, CSS3 , BootStrap
  • Frameworks: .NET Core 2.1+ (required), Azure PaaS, Jquery, ReactJS, Blazor
  • Databases: NoSQL db (Azure Cosmos, MongoDB), SQL Server, Azure SQL, Azure Tables, Stored Procedure Development, Performance Tuning
  • Working with CI/CD Pipelines in Azure DevOps
  • Experience with MS D365, D365 F&O, X++ are a plus
  • XUnit/Moq are a plus

 

Candidates will be responsible for following the client's COVID-19 protocols. Please refer to your MATRIX representative for specifics.

About Us

At MATRIX, we expertly match talented professionals with job opportunities to elevate careers. Since 1983, we have placed thousands of professionals at innovative clients across every industry ranging from small startups to Fortune 50 companies. It’s why we’re consistently in the top 25 of all U.S. IT staffing firms and why our consultants rate us well above the industry average, earning us ClearlyRated's Best of Staffing awards year after year. People come to us for a job, and stay with us because of our top-notch consultant care.

MATRIX is and Equal Employment Opportunity employer including disability and veteran and provides reasonable accommodations for all qualified individuals.  Supporting medical or religious documentation will be required where applicable. If you are a qualified individual you may request a reasonable accommodation under the American Disability Act (ADA). If you are a person with a disability needing assistance applying, or at any point in the hiring process, please email us at MATRIX_HR@MatrixRes.com. To ensure a quick response to your request, please use the words “Accommodation request” as the subject line of your email.

For hourly W2 contract roles MATRIX offers a highly competitive benefit package including Medical, Dental, Vision, Life, Disability, HSA, and 401(k) with pre and post-tax options.  Please see MatrixRes.com/Benefits for more information.

For direct hire placement with our clients, benefits would be offered in accordance with that particular client’s offerings. This may include PTO, Medical, Dental, Vision, 401K and other pre and post-tax options.