Data Engineer

<p><strong>Overview:</strong></p>
<p>The Data Engineer is responsible for developing, maintaining, and supporting data pipelines using Python and SQL Server (T-SQL), while assisting with data integration from internal and external systems within a modern Azure-based data platform. The role supports critical data operations in regulated environments and provides opportunities for hands-on learning and growth under the guidance of senior data engineers. </p>
<p><strong>Job Description:</strong></p>
<ul>
<li>Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from various data sources, including structured files and RESTful APIs.</li>
<li>Write, test, and debug Python code for data processing, automation, and basic integrations following established standards and best practices.</li>
<li>Create and maintain T-SQL queries, views, and stored procedures to support business logic and reporting requirements.</li>
<li>Assist in building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage.</li>
<li>Support the monitoring of data pipelines and help troubleshoot data quality issues, pipeline failures, and performance problems.</li>
<li>Follow defined data quality, security, and compliance procedures in regulated environments such as healthcare and financial services.</li>
<li>Collaborate with data analysts, software engineers, and DevOps teams to understand data requirements and upstream systems.</li>
<li>Participate in code reviews, implement feedback, and continuously improve coding and engineering practices.</li>
<li>Create and maintain clear documentation for data pipelines, logic, and operational processes.</li>
</ul>
<p><strong>Qualifications and Experience: </strong></p>
<p><strong>Education</strong></p>
<ul>
<li>Bachelor’s Degree — Preferred </li>
</ul>
<p><strong>Experience</strong></p>
<ul>
<li>1–4 years of professional experience in Data Engineering, Software Engineering, or a related technical role — Required</li>
<li>Strong hands-on proficiency in Python, including writing functions, handling errors, and debugging code — Required</li>
<li>Experience working with relational databases, preferably SQL Server — Required</li>
<li>Strong working knowledge of SQL, including joins, aggregations, subqueries, and basic performance considerations — Required</li>
<li>Exposure to integrating or consuming data from RESTful APIs or external data sources — Required</li>
<li>Familiarity with Git or similar version control systems — Required</li>
<li>Strong analytical and problem-solving skills with the ability to learn quickly — Required</li>
</ul>
<p><strong>Preferred Experience</strong></p>
<ul>
<li>Experience with additional Azure services such as Azure Synapse, Azure DevOps, and Azure Functions</li>
<li>Understanding of data modeling and warehousing concepts</li>
<li>Exposure to cybersecurity data, SIEM tools, or SOC operations</li>
<li>Knowledge of .NET Framework and C#-based APIs, particularly in data consumption contexts</li>
<li>Background in MSP/MSSP environments or consulting</li>
<li>Familiarity with Power BI or other data visualization tools</li>
</ul>
<p><strong>Knowledge, Skills, and Abilities: <br></strong></p>
<ul>
<li>Exposure to Azure data services such as Azure Data Factory, Azure SQL, or Blob Storage.</li>
<li>Basic understanding of ETL concepts, data validation, and pipeline monitoring.</li>
<li>Familiarity with data modeling fundamentals, including tables, keys, and relationships.</li>
<li>Awareness of data security, privacy, and compliance standards such as HIPAA and SOC2.</li>
<li>Experience with Power BI or other data visualization tools.</li>
<li>Basic understanding of application systems or APIs built using .NET or similar frameworks.</li>
<li>Ability to design and support scalable ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from diverse sources.</li>
<li>Ability to develop and optimize T-SQL stored procedures to support business logic and reporting needs.</li>
<li>Ability to support secure and efficient data workflows using Azure Data Factory, Azure SQL, and Azure Functions.</li>
<li>Ability to help ensure data quality, lineage, and compliance requirements are maintained.</li>
<li>Ability to collaborate with software engineering, data analytics, security, and DevOps teams.</li>
<li>Ability to monitor and troubleshoot pipeline failures and data discrepancies.</li>
<li>Ability to participate in code reviews and continuously improve engineering practices.</li>
</ul>
<p><strong>Attributes that will drive success:</strong></p>
<ul>
<li>Ability to work effectively in a collaborative, fast-paced environment.</li>
<li>Good written and verbal communication skills.</li>
</ul>
<p> </p>
<p> </p>