Job Description

Job Description: Databricks & Azure Data Platform Principal Engineer
Location: Warren, NJ (Hybrid - 3 days in-office required)

Overview:
We are seeking a highly skilled Databricks & Azure Data Platform Principal Engineer for a Re-Insurance client based in Warren, NJ . This is a senior-level role focused on designing, building, and optimizing data solutions using Databricks and Azure Data Platform technologies. The Principal Engineer will oversee the architecture, integration, development, and deployment of reusable data solutions, ensuring they are scalable, secure, and efficient.

Key Responsibilities:

• Platform Architecture & Integration: Design and develop data solutions using Databricks and Azure Data Platform to meet business needs. Ensure the architecture is scalable, secure, and highly efficient.
• Data Pipeline Development: Work closely with developers, analysts, and data scientists to implement data pipelines, real-time analytics, and machine learning models.
• Automation & Optimization: Manage the platform effectively by implementing automation solutions. Optimize costs, performance, and system reliability through emerging capabilities in the marketplace.
• Best Practices & Governance: Establish modern best practices for data governance , data architecture , and DataOps within the cloud data ecosystem. Ensure best practices are adhered to by all teams.
• Performance Tuning & Reliability: Provide guidance on performance tuning, data pipeline optimization, and system reliability. Ensure systems are highly available and performant.
• Collaboration & Leadership: Collaborate with cross-functional teams, including developers, analysts, and stakeholders, to ensure successful design, development, and deployment of data solutions.
• Cloud Data Ecosystem Leadership: Act as the subject matter expert for the cloud data ecosystem, ensuring its evolution in line with the latest technologies and industry trends.

Key Skills & Experience:

• Databricks & Azure Expertise: Proven experience with Databricks and Azure Data Platform in a production environment, including data integration, management, and optimization.
• Data Pipeline & Analytics: Strong background in building and managing data pipelines, real-time analytics, and machine learning workflows.
• Automation & Cloud Management: Experience implementing automation in cloud platforms, specifically Azure, for cost and performance optimization.
• Data Governance & DataOps: Knowledge of data governance and DataOps best practices in cloud environments.
• Performance & Cost Optimization: Experience with tuning cloud data systems for optimal performance and cost efficiency.
• Leadership & Collaboration: Ability to lead teams and collaborate effectively with various stakeholders, including developers, data scientists, and business analysts.

Job Tags

Similar Jobs