SmartZip is looking for a Data Engineer to join our team and help us build and maintain our data pipelines. The ideal candidate will have a strong background in data engineering and experience with big data technologies.

Responsibilities:

• Design, develop, and maintain data pipelines for publishing data internally and externally
• Maintain and debug Elastic Map Reduce (using Hive/Impala/Spark) jobs
• Work directly with data support analysts to help reproduce and resolve critical, highly complex customer problems
• Perform exploratory data analysis to answer various business questions
• Communicate the results of an analysis to stakeholders in a clear and concise manner

Qualifications:

• Bachelor’s degree in Information Science, Information Technology, Computer Science, Engineering, Mathematics, Physics, or a related field
• 3+ years of experience in data engineering
• Proficient in Apache Spark, Scala, R, and Java
• Experience with AWS (including EC2, S3, EBS, RDS, Redshift, EMR)
• Relational database experience
• Strong SQL scripting and optimization experience
• Experience with UNIX system administration, system monitoring, analysis, and scripting
• Customer service experience / strong customer focus
• Basic coding/scripting ability in Shell, Ruby, and Python
• Good understanding of distributed computing environments
• Exposure to security concepts / best practices
• Exposure or experience in Jenkins, Airflow, or similar CI/CD platforms
• Excellent oral and written communication skills
• Strong analysis and troubleshooting skills and experience

Benefits:

• Competitive salary and benefits package
• Opportunity to work on cutting-edge technology
• Collaborative and supportive work environment
• Chance to make a real impact on the data industry

If you are a passionate and motivated Data Engineer with a strong desire to make a difference, we encourage you to apply!