[Remote] Senior Data Engineer – Real-Time Data & Visualization Focus
Note: The job is a remote job and is open to candidates in USA. Highmark Health is a prominent healthcare organization, and they are seeking a Senior Data Engineer with a focus on real-time data and visualization. In this role, you will contribute to the data infrastructure, ensuring efficient data flow and creating impactful visualizations for internal and enterprise reporting. Responsibilities • Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems • Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs • Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs • Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly • Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations • Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking • Mentor other associate and intermediate data engineers as needed • Perform data analysis and provide insights to support decision-making across various departments • Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed • Other duties as assigned or requested Skills • CANDIDATE MUST BE US Citizen (due to contractual/access requirements) • 5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems • 5 years of experience in a data engineering, ETL development, or data management role • 5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB) • 5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery) • Bachelor's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field • 7 years of experience with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory) • 7 years of experience defining system architectures and exploring technical feasibility trade-offs for optimizing short term execution while planning for long term technical capabilities • 7 years of experience working with a variety of technology systems, designing solutions or developing data solutions in healthcare • 7 years of experience with cloud platforms (AWS, Azure, GCP) and their respective data services • 7 years of experience in data governance, data quality, and data security best practices • 7 years of experience translating requirements, design mockups, prototypes or user stories into technical designs • 7 years of experience in producing data-related code that is fault-tolerant, efficient, and maintainable • 7 years of experience structuring and transforming data from multiple source systems • 7 years of experience creating data visualizations and dashboards using Power BI or Tableau for internal and external audiences • 7 years of experience using Cribl as a steaming and transformation solution • Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field Company Overview • Highmark Health is an integrated health care delivery and financing network. It was founded in 1848, and is headquartered in Pittsburgh, Pennsylvania, USA, with a workforce of 10001+ employees. Its website is Apply tot his job