Data Engineer

Job Title: Senior Data Engineer
Location: Remote
Employment Type: Full-Time

About Us:

DMV IT Service LLC is a trusted IT consulting firm founded in 2020. We specialize in optimizing IT infrastructure and providing expert guidance to empower businesses to achieve their technology goals. Our services span system administration, cybersecurity, networking, and IT operations. With a client-first approach, we ensure long-term success for our clients through innovative solutions and industry best practices.

Job Purpose:

We are seeking a Senior Data Engineer to join our client's Data & Analytics team. This role is crucial for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. The ideal candidate will collaborate with various teams to create scalable and efficient data pipelines, ensuring data accuracy and integrity, and enabling high-quality decision-making processes. You will play a critical role in driving data-driven innovation and enhancing the company’s competitive edge.

Requirements

• Data Pipeline Development:
• Design and develop data pipelines to extract data from various sources, transform it into usable formats, and load it into appropriate storage systems.
• Ensure the smooth integration of data from databases, data warehouses, APIs, and external systems.
• Collaboration & Stakeholder Engagement:
• Work closely with architects, data scientists, AI engineers, and analysts to manage data as an asset and optimize models and algorithms for data quality, security, and governance.
• Partner with business teams to translate their needs into scalable data engineering solutions.
• Data Quality & Performance:
• Implement and monitor data quality checks to ensure accuracy, consistency, and completeness in the data pipelines.
• Optimize the performance and scalability of data pipelines and data processing workflows.
• Automation & Integration:
• Implement automated solutions to enhance data management and reporting processes.
• Integrate various data sources and automation tools, including Azure Data Factory, Azure Databricks, and other industry-standard platforms.
• System Monitoring & Tuning:
• Monitor data systems for performance bottlenecks and ensure efficient query performance through caching and indexing strategies.
• Resolve issues and enhance system performance as needed.
• Data Analysis & Reporting:
• Analyze data to identify trends and patterns that can drive actionable insights for business decision-making.
• Prepare documentation of data architectures, workflows, and testing processes to ensure clarity and supportability.

Qualifications:

• Required Skills & Experience:
• Bachelor’s degree in Computer Science, Data Science, Software Engineering, Information Systems, or a related quantitative field.
• 8+ years of experience in data engineering, with experience in data modelling, ETL/ELT, data integration, data governance, and data warehousing.
• Strong proficiency in programming languages like Java, Python, and SQL.
• Expertise in cloud platforms, specifically Azure and AWS services.
• Hands-on experience with PostgreSQL, MongoDB, Redis, and other relevant data management technologies.
• Experience with data visualization tools like Power BI and Tableau.
• Technical Skills:
• Experience with integration technologies such as Kafka, REST, GraphQL.
• Proficient in data pipeline orchestration using tools like Azure Data Factory and Databricks.
• Experience with containerization (e.g., Docker, Kubernetes) and cloud data management tools.
• Strong knowledge of DevOps and CI/CD pipelines in a cloud environment.
• Soft Skills:
• Strong problem-solving skills and a critical thinker with the ability to translate complex data into actionable insights.
• Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical audiences.
• Ability to work independently and collaboratively with cross-functional teams.
• Strong organizational skills and the ability to manage multiple projects concurrently.

Nice to Have:

• Certifications in relevant technologies such as AWS, Azure, or Google Cloud.
• Experience in the professional services or accounting industry.
• Previous experience in a consultative role or client-facing role.
• Experience working in a managed services provider (MSP) environment.