Data Engineer – ETL & Pipeline Specialist
Us At Aretec, Inc., we are catalysts for change within the federal government landscape. Specializing in advanced analytics, machine learning, data analysis, cybersecurity, and business optimization, we empower federal agencies to achieve their most critical missions. As a premier partner and prime vendor, we deliver innovative, high-impact solutions that address complex challenges and drive national progress. Our commitment to excellence and innovation positions us at the forefront of transforming governmental operations, enhancing efficiency, and making a lasting difference in the lives of citizens. You You are a dynamic and visionary professional who thrives on transforming complex challenges into innovative solutions. With a passion for cutting-edge technology and a commitment to excellence, you are always seeking new ways to make a meaningful impact. You excel in environments where collaboration and creativity are key, and you are driven by the opportunity to contribute to initiatives that shape the nation's future. Your expertise and enthusiasm empower you to lead projects that not only meet but exceed the objectives of federal missions. You are eager to bring your skills to a team that values your contributions and supports your professional growth. What We're Looking For We are seeking a Data Engineer – ETL & Pipeline Specialist who will play a pivotal role in enhancing our organization's capabilities and advancing the missions of our federal partners. In this role, you will build and maintain our ETL infrastructure using Apache Airflow, ensuring reliable data flow into our Starburst platform and rebuilding pipelines for improved performance and scalability. Key Responsibilities • Design and implement ETL pipelines using Apache Airflow • Rebuild existing data pipelines for improved performance and reliability • Develop SQL queries and optimize database performance • Load and transform data for ingestion into Starburst • Pre-build optimized queries for common financial analyses • Create data models for equity positions and financial metrics • Maintain data quality and implement validation checks • Document data flows and pipeline architectures • Collaborate with Python developers on data interfaces The Skills We're Looking For Required Qualifications • 5+ years of experience in data engineering • Experience in Apache Airflow • Advanced SQL skills and query optimization experience • Proficiency in Python for data processing • Experience with data warehousing concepts • Understanding of ETL best practices • Experience with data pipeline monitoring and alerting • Bachelor's degree in Computer Science, Data Engineering, or related field Preferred Qualifications • Knowledge of financial data and equity markets • Experience transitioning from Excel-based processes to automated pipelines • Familiarity with cloud data platforms (AWS preferred) • Understanding of data governance and security practices The Expectations of the Job Day One: • Orientation and Onboarding: Immerse yourself in Aretec's culture, values, and mission. Begin building relationships with your team and familiarize yourself with our current projects and federal partners. Day Thirty: • Active Contribution: Start actively participating in ETL and pipeline projects, bringing fresh ideas and perspectives. • Skill Application: Apply your expertise in Apache Airflow, SQL, and Python to initial tasks. Day Sixty: • Project Leadership: Take on more significant responsibilities within pipeline rebuilding and optimization efforts. • Strategic Planning: Contribute to discussions on scalable data architecture and emerging ETL practices. • Stakeholder Interaction: Engage more deeply with federal partners, tailoring data solutions to their operational needs. Day Ninety: • Full Ownership: Assume full ownership of key ETL and pipeline initiatives, driving them from conception to successful completion. • Innovation and Improvement: Identify opportunities for process improvements and innovation across data workflows and infrastructure. • Mentorship Role: Actively mentor junior engineers, sharing your knowledge and fostering continuous learning. Benefits At Aretec, we believe that our employees are our greatest asset. We offer a comprehensive benefits package designed to support your health, well-being, and professional development: • Health, Dental, and Vision Insurance • 401(k) Plan with Employer Match • Certification Stipends • Professional Development Opportunities • Flexible Work Arrangements (including remote work options) • Paid Time Off and Holidays Citizenship Requirement Please note that due to the nature of our federal contracts and the secure environments in which we operate, only applicants who are sole U.S. Citizens can be considered for this position. Equal Opportunity Employer Aretec, Inc. is proud to be an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified individuals will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other legally protected characteristics. Apply tot his job Apply tot his job