Sr Data Engineer (Databricks)

• Knowledge or experience with infrastructure (operating system and networking) and cloud administration and automation such as Terraform for Infrastructure as Code.
• Knowledge of DevOps in application development such as GitHub Actions, or Powershell
• Experience with application development using Microsoft or cloud technologies (such as SQL, Azure, C#, Python)
• Experience with Machine Learning, MLOps
• Experience with investment management systems and processes
• Experience with Agile methodologies in a cloud, application, database, data warehousing and BI space

Responsibilities

• Work with business and technology partners to analyze how the data warehouse, analytics and application will meet our goals
• Evaluate all proposed requests to determine fit with data warehouse, analytics and application solution architecture.
• Own data warehouse and analytics technical platform on Azure, from implementation to enhancements and ongoing operations
• Design, develop and coordinate cloud data and application solutions/projects across diverse groups and areas including enterprise architecture, application development, identity and access management, network and data management
• Provide technical direction and guidance to database and application developers
• Develop cloud security and access control solution/policy, data and BI standards, guidelines and best practice for business groups and technical teams
• Perform maintenance and troubleshooting activities for data warehouse, BI platform and other data projects and resolve issues
• Monitor system application logs and identify potential issues and improvements to ensure smooth operations
• Perform capacity planning, cloud cost analysis and optimization and provide recommendations to management
• Provide after-hour system and application support
• Develop multiple work plans for projects and prepare appropriate status reports and submit them to management