Data Engineer

Job Description

We seek a Data Engineer who will be integral in our data analytics operations. You will design and implement data pipelines, develop scalable data architectures, and ensure data quality and integrity while collaborating with cross-functional teams. Your role is crucial in shaping the data landscape of Data Solutions Inc.

Responsibilities

• Design and implement scalable data pipelines using tools like Apache Spark and Kafka.
• Monitor data flow and troubleshoot issues in real-time.
• Develop and maintain ETL processes to ensure data quality and integrity.
• Collaborate with data analysts and data scientists to understand data requirements and ensure datasets meet business needs.
• Optimize existing data architectures to improve performance and reduce costs.
• Document data workflows and processes for enhanced team collaboration.

Requirements

Education

• Bachelor's degree in Computer Science, Data Science, or equivalent
• Master's degree in Data Engineering or related field preferred

Experience

• 3-5 years of experience in data pipeline development and management

Technical Skills

• Java
• NoSQL

Soft Skills

• Critical Thinking
• Adaptability

Certifications

• Google Cloud Professional Data Engineer
• Certified Data Management Professional (CDMP)

Languages

• English: Fluent

Advantageous

• Experience with Docker and Kubernetes: Familiarity with container orchestration tools to enhance data workflows.
• Knowledge of Data Warehousing Solutions: Experience with data warehousing technologies such as Snowflake or Redshift.

Benefits

• Comprehensive health insurance coverage
• 401(k) retirement plan with employer match
• Flexible work schedules
• Remote work opportunities
• Professional development support

Company Culture

• Innovation at Core: We thrive on innovative ideas and foster an environment where creativity is celebrated.
• Collaboration: Our team values collaboration and teamwork, working together to achieve common goals.
• Diversity and Inclusion: Committed to building a diverse workforce where every voice is valued.