Experienced Data Engineer for Remote Opportunities - Cloud Data Pipelines and Distributed Systems Development at blithequark

Introduction to blithequark and the Industry blithequark is a leading player in the logistics and transportation industry, leveraging cutting-edge technology to drive innovation and excellence. As a data-driven organization, blithequark recognizes the importance of skilled data engineers in developing and maintaining large-scale data pipelines, ensuring seamless data flow, and providing actionable insights to stakeholders. The data engineering field is rapidly evolving, with a growing demand for professionals who can design, build, and maintain complex data systems. If you are a motivated and experienced data engineer looking for a challenging remote opportunity, blithequark invites you to join their team as a Data Engineer. Job Overview In this role, you will be responsible for supporting the design, build, test, and maintenance of data pipelines at a large scale. Your primary obligations will include updating data from multiple sources, working on batch processing of collected data, and ensuring that the data is properly formatted and analyzed. You will also be involved in optimizing the environment and pipeline, investigating performance issues, and providing level 3 support. Additionally, you will implement parsers, validators, transformers, and correlators to reformat, update, and upgrade the data, and provide guidance to less senior team members. Key Responsibilities Design, develop, and maintain large-scale data pipelines and architectures Collaborate with cross-functional teams to deliver key business initiatives Work on code reviews and large-scale solutions Build tools, platforms, and pipelines to enable teams to analyze data, build models, and drive decisions Scale from "PC scale" to "cluster scale" issues, in terms of both infrastructure and problem construction and strategy Deliver substantial value quickly, working with different teams of changing backgrounds and disciplines Develop and implement best practices for future reuse as open, reusable patterns, templates, and code bases Collaborate with senior technologists from the wider organization and beyond blithequark to create collaborations and ensure smooth solutions to downstream operational systems Essential Qualifications To be successful in this role, you should have a Bachelor's degree in a relevant field, such as computer science, software engineering, or a related discipline. You should also have a strong technical foundation in programming languages, database systems, and distributed systems. Preferred Qualifications Advanced degree in a relevant field, such as computer science, software engineering, or a related discipline Experience working in the transportation and logistics space, with a deep understanding of the industry and the ability to identify high-opportunity areas and design approaches and solutions that generate and capture value Proficiency in Microsoft Azure and experience with building CI/CD pipelines Knowledge of and experience with building and operationalizing functions and solutions, including near-real-time high-volume streaming scenarios Strong problem-solving skills, with the ability to work at the code level and help troubleshoot hard-to-resolve issues Proven ability to deliver technical projects, often working under tight deadlines to deliver value An "engineering" mindset, able to make fast, pragmatic decisions to improve performance and accelerate progress Comfort working with distributed teams on code-based expectations, using version control systems and code reviews DevOps experience, with knowledge of coding, scripting, database, yaml, json, and IaC (Terraform) Skills and Competencies To excel in this role, you should possess a range of technical skills, including: Programming languages, such as Scala, PySpark, and Python Database systems, including SQL and NoSQL storage devices, such as MySQL, Postgres, Cassandra, MongoDB, and ElasticSearch Distributed systems, including HDFS, Kafka, and other high-volume data tools Data analysis and machine learning libraries, such as Pandas, Scikit-Learn, Matplotlib, TensorFlow, and Jupyter Cloud platforms, including Microsoft Azure Agile development methodologies and version control systems, such as Git Career Growth Opportunities and Learning Benefits At blithequark, we are committed to the growth and development of our employees. As a Data Engineer, you will have access to a range of training and development opportunities, including: Technical training and certification programs Mentorship and coaching from experienced professionals Opportunities to work on high-impact projects and contribute to the development of our data engineering capabilities Collaboration with cross-functional teams and exposure to different technologies and domains Work Environment and Company Culture blithequark is a dynamic and innovative organization that values diversity, inclusion, and collaboration. Our company culture is built on a foundation of: Respect and empathy for our employees, customers, and partners A commitment to excellence and a passion for innovation A focus on teamwork and collaboration A dedication to continuous learning and improvement Compensation, Perks, and Benefits As a Data Engineer at blithequark, you can expect a competitive salary and benefits package, including: A hourly rate of $28/hour Comprehensive health and wellness benefits Retirement savings plan and matching program Paid time off and holidays Opportunities for professional development and growth Conclusion If you are a motivated and experienced Data Engineer looking for a challenging remote opportunity, we encourage you to apply for this role at blithequark. With a strong foundation in data engineering and a passion for innovation, you will be well-positioned to succeed in this role and contribute to the growth and development of our organization. Apply now to join our team and take the first step towards an exciting and rewarding career at blithequark. Apply! Apply for this job