Experienced Remote Data Engineer – Large Scale Data Pipelines and Information Systems Development at arenaflex

Introduction to arenaflex and the Industry arenaflex is a leading player in the private industry, committed to innovation and excellence in all aspects of its operations. As a remote data engineer at arenaflex, you will be part of a dynamic team that is passionate about creating and driving engineering innovation and delivering key business initiatives. The data engineering team at arenaflex plays a vital role in making and driving engineering development and working with the delivery of key business drives. As a "universal translator" between IT, business, programmers, and data scientists, data engineers collaborate across multi-disciplinary teams to deliver value. Job Summary We are seeking an experienced remote data engineer to support the design, build, test, and maintain large-scale data pipelines and information systems. The successful candidate will have a strong technical background in computer science, software engineering, database systems, and distributed systems. The ability to work collaboratively across teams, identify high-opportunity areas, and design approaches and solutions that create and capture value is essential. The remote data engineer will be responsible for working on those parts of the Dataworks platform that manage the ingestion, transformation, and pipelining of data assets, both to end-users inside arenaflex and into data products and services that may remotely face. Key Responsibilities Support the design, build, test, and maintain large-scale data pipelines and information systems Help update data from multiple data sources and work on team handling of collected data to match its format to the stored data Ensure that the data is to be processed and analyzed, and maintain the ecosystem and pipeline optimized and efficient Investigate standard performance, data-related issues, and provide L3 support Implement parsers, validators, transformers, and correlators to reformat, update, and improve the data Provide suggestions to highly complex issues and give guidance to those in less senior positions Collaborate with senior technologists from the wider enterprise and beyond arenaflex to create collaborations and ensure smooth integrations to downstream operational systems Essential Qualifications Bachelor's degree in Computer Science, Software Engineering, or a related field Technical background in software engineering, database systems, and distributed systems Sharp understanding of the transportation and operations space with the ability to identify high-opportunity areas and design approaches and solutions that create and capture value Development experience in Microsoft Azure Knowledge of and demonstrated expertise in building CI/CD pipelines Experience in creating and operationalizing functions and solutions, including under near real-time high-volume streaming scenarios Preferred Qualifications Involved development skills with the ability to work at the code level and help troubleshoot hard-to-determine issues Demonstrated ability to deliver technical projects, often working under close time constraints to deliver value An 'engineering' mindset, able to make fast, pragmatic decisions to improve performance and accelerate progress Comfort with working with distributed teams on code-based expectations, using version control systems and code reviews DevOps: regarding technology, should have all the knowledge like coding, scripting, database, yaml, json, and IaC (Terraform) Demonstrated expertise working with some of the following common languages and tools: Spark (Scala and PySpark), HDFS, Kafka, and other high-volume data tools SQL and NoSQL storage devices, such as MySQL, Postgres, Cassandra, MongoDB, and ElasticSearch Pandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter, and other Python data tools Career Growth Opportunities and Learning Benefits At arenaflex, we are committed to the growth and development of our employees. As a remote data engineer, you will have the opportunity to work on complex and challenging projects, collaborate with experienced professionals, and develop your skills and expertise in a dynamic and supportive environment. You will also have access to training and development programs, mentorship, and career advancement opportunities. Work Environment and Company Culture arenaflex is a dynamic and innovative company that values collaboration, creativity, and excellence. Our remote work environment is designed to support flexibility, productivity, and work-life balance. We believe in fostering a culture of inclusivity, diversity, and respect, and we are committed to creating a positive and supportive work environment for all employees. Compensation, Perks, and Benefits arenaflex offers a competitive compensation package, including a salary of $25 per hour, as well as a range of perks and benefits, such as health insurance, retirement plans, and paid time off. We also offer opportunities for professional development, career advancement, and recognition and rewards for outstanding performance. Conclusion If you are a motivated and experienced data engineer looking for a challenging and rewarding role, we encourage you to apply for this exciting opportunity at arenaflex. As a remote data engineer, you will have the chance to work on complex and innovative projects, collaborate with experienced professionals, and develop your skills and expertise in a dynamic and supportive environment. Don't miss out on this opportunity to join a leading company in the industry and take your career to the next level. Apply now to become a part of the arenaflex team and start building a successful and fulfilling career as a remote data engineer. Apply for this job