Data Engineer-(Scala and Spark)
Job Description
We are looking for a highly skilled Data Engineer with expertise in Scala and Apache Spark to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions to manage and process large datasets efficiently.
Key Responsibilities: ? Design and implement robust, scalable, and high-performance data pipelines using Scala and Apache Spark. ? Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. ? Optimize data processing systems and ensure their scalability and efficiency. ? Work on data extraction, transformation, and loading (ETL) processes for various structured and unstructured datasets. ? Implement best practices for data engineering, including data governance, data quality, and monitoring. ? Debug and resolve data processing and performance issues promptly. ? Ensure data security and compliance with relevant regulations and guidelines.
Skills & Qualifications: ? Strong programming skills in Scala with 3+ years of hands-on experience. ? Proficiency in Apache Spark for large-scale data processing. ? Familiarity with Hadoop Ecosystem (e.g., HDFS, Hive, HBase) is a plus. ? Experience with cloud platforms like AWS, Azure, or GCP. ? Knowledge of relational and non-relational databases (e.g., PostgreSQL, MongoDB). ? Hands-on experience with data versioning, CI/CD pipelines, and orchestration tools (e.g., Airflow). ? Strong problem-solving skills and ability to work in an Agile environment. ? Knowledge of containerization tools (Docker, Kubernetes) is an advantage.
Educational Background:
? Bachelor?s or Master?s degree in Computer Science, Engineering, or a related field.
Experience: 3-6 years
Similar Remote Jobs
Data Engineer-(Scala and Spark)
Posted on: 22-11-2024 05:34
Delta work from home jobs
Posted on: 22-11-2024 05:34
Remote Embedded Software Engineer Jobs
Posted on: 22-11-2024 05:34
Remote Customer Chat Support Specialist ? Entry Level
Posted on: 22-11-2024 05:34
(Ohio) Virtual Assistant, Remote Mystery Shopper Needed ???
Posted on: 22-11-2024 05:34
Behavioral Health | Flexible Schedule| Remote
Posted on: 22-11-2024 05:34
WFH Call Center Representative Remote
Posted on: 22-11-2024 05:34
Remote Data Entry Clerk No Experience
Posted on: 22-11-2024 05:34
Now Hiring Remote Sales Experts: Apply Today
Posted on: 22-11-2024 05:34
Remote Online Amazon Chat Jobs No Experience ? Easy Jobs Hiring Near Me ? No Experience Needed
Posted on: 22-11-2024 05:34
Lead - HR Operations
Posted on: 16-11-2024 00:00
Associate Counsel (Remote)
Posted on: 16-11-2024 00:00
Developer II (C# .NET, SQL) (Remote from anywhere in CO)
Posted on: 03-02-2025 00:00
Fulfillment - Package/Sorter
Posted on: 20-01-2025 00:00
Outride Business Development and Communications Specialist
Posted on: 16-07-2024 18:44
Remote Chat Support Assistant
Posted on: 28-10-2024 09:48
(Part-Time Remote Jobs ) Walmart Work From Home ? Hiring Now
Posted on: 15-09-2024 00:00
Booking Coordinator (REMOTE)
Posted on: 09-11-2024 04:39
Telephonic Health Advisor
Posted on: 19-09-2024 00:00
Contact Center Representative - Work From Home
Posted on: 31-07-2024 19:11