Lead Data Engineer - Crafting Innovative Data Solutions at blithequark - $24/Hour

Unlock Your Potential as a Lead Data Engineer at blithequark Are you a highly motivated and detail-oriented individual with a passion for Big Data and a knack for developing cutting-edge data solutions? Do you have a strong technical background and a desire to dive deeper into the world of data engineering? If so, blithequark is looking for you to join our team as a Lead Data Engineer and be part of a dynamic group that is shaping the future of data-driven decision-making. About blithequark and the Industry At blithequark, we're at the forefront of the data revolution, harnessing the power of information to drive business growth, improve customer experiences, and inform strategic decisions. Our Information and Investigation group is a critical component of this effort, working tirelessly to develop and implement innovative data solutions that meet the evolving needs of our organization. As a Lead Data Engineer, you'll be an integral part of this team, working closely with cross-functional stakeholders to design, develop, and deploy data products and warehouses that drive business value. Key Responsibilities Design and Development: Contribute to the design and development of our Data Products and Data Warehouses, focusing on Engagement and Retention Analysis and Data Science. This will involve creating scalable data warehousing solutions, building ETL pipelines in large data environments (cloud, on-prem, hybrid), and working with a tech stack that includes Hadoop, AWS, Snowflake, Flink, and Wind stream, as well as languages like Python and Scala. Data Solutions and Architecture: Help engineer data solutions/structures and define data models for our critical data warehouse and data marts. You'll work closely with Data Product Managers, Data Modelers, and Data Architects to design, implement, and deliver successful data solutions that meet business needs. Documentation and Quality: Maintain detailed documentation of your work and changes to support data quality and data governance. Ensure high operational efficiency and quality of your solutions to meet SLAs and uphold our commitment to our clients (Data Science, Data Analytics teams). Agile Practices: Be an active participant and advocate for agile/scrum practices to ensure safety and process improvements for your team. This includes collaborating with your team to identify areas for improvement and implementing changes that enhance overall performance. Essential Qualifications Bachelor's Degree: A Bachelor's degree in a relevant field is required, providing a foundation in computer science, information technology, or a related discipline. SQL Skills: Strong SQL skills and the ability to write queries to extract data and build performant datasets are essential. You'll be working with complex data sets and need to be able to craft efficient queries. Distributed Systems Experience: Hands-on experience with distributed systems like Flink, Hadoop (HDFS, Hive, Voila, PySpark) is necessary to query and process data effectively. Programming Skills: Proficiency in programming languages such as Python, Java/Scala is required. You'll be working with these languages to develop data solutions and pipelines. MPP or Cloud Database Experience: Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query) is a must. You'll be working with these technologies to design and implement data warehousing solutions. Data Integration and Pipelines: Strong experience with data integration toolsets (e.g., Wind current) and writing and maintaining Data Pipelines is necessary. You'll be responsible for designing and implementing data pipelines that are efficient and scalable. Data Modeling and Warehousing: Solid understanding of Data Modeling methodologies and Data Warehousing best practices and standards is required. You'll be working with data models and warehouses to drive business insights. Agile Methodologies: Familiarity with Scrum and Agile methodologies is essential. You'll be working in an agile environment and need to be able to adapt to changing requirements. Problem-Solving and Communication: You're an issue solver with strong attention to detail and excellent analytical and interpersonal skills. You'll be working with cross-functional teams and need to be able to communicate complex technical concepts effectively. Preferred Qualifications Cloud Technologies: Experience with Cloud technologies like AWS (S3, EMR, EC2) is highly desirable. While not required, having experience with cloud technologies will be a significant plus. Career Growth Opportunities and Learning Benefits At blithequark, we're committed to helping our team members grow and develop their skills. As a Lead Data Engineer, you'll have opportunities to work on complex and challenging projects, collaborate with experienced professionals, and develop your technical and leadership skills. You'll also have access to ongoing training and development programs to help you stay up-to-date with the latest technologies and trends. Work Environment and Company Culture blithequark is a dynamic and inclusive organization that values diversity, equity, and inclusion. Our work environment is collaborative and fast-paced, with a focus on innovation and creativity. We offer a range of benefits and perks to support our team members' well-being and work-life balance, including competitive compensation, flexible work arrangements, and opportunities for professional growth and development. Compensation and Benefits We're offering a competitive salary of $24/Hour for this role, along with a comprehensive benefits package that includes health insurance, retirement savings, and paid time off. We also offer a range of perks, including flexible work arrangements, professional development opportunities, and access to cutting-edge technologies. Join blithequark and Shape the Future of Data-Driven Decision-Making If you're a motivated and detail-oriented individual with a passion for Big Data and a knack for developing innovative data solutions, we want to hear from you. As a Lead Data Engineer at blithequark, you'll have the opportunity to work on complex and challenging projects, collaborate with experienced professionals, and drive business growth through data-driven decision-making. Apply now to join our team and start shaping the future of data engineering! Apply for this job