Senior Data Engineer

PriceIntelGuru are hiring a Senior Data Engineer

12.12.24

We are seeking an experienced Senior Data Engineer to join our innovative team. In this role, you will be responsible for designing and maintaining the infrastructure necessary for optimal extraction, transformation, and loading (ETL) of data from various sources. Your expertise will be crucial in assembling complex datasets that drive actionable insights and support data-driven decision-making within the organization.

Role and Responsibilities

Data Infrastructure Development: Design and maintain robust infrastructure for the optimal extraction, transformation, and loading of data from diverse sources.

Complex Data Management: Assemble and manage large and complex datasets that meet business requirements, transforming raw data into meaningful information.

Automation and Optimization: Automate manual processes and optimize data delivery using SQL and Python scripts; enhance infrastructure for improved scalability and efficiency.

Data Validation and Analysis: Develop data validation methods and create data analysis tools to ensure data accuracy and reliability.

Machine Learning Integration: Implement machine learning techniques to develop and sustain data structures that facilitate advanced analytics and insights.

Scalable Data Pipelines: Build and maintain scalable data pipelines and develop API integrations to accommodate increasing data volume and complexity.

ETL Job Management: Execute ETL jobs and integrate with data visualization platforms, ensuring seamless access to dashboards and analytic reports.

Schema Design and Maintenance: Create and maintain schemas to ensure organized and accessible data storage solutions.

Skills and Requirements

Educational Background:

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field.

Candidates from non-computer disciplines (e.g., B.Sc./B.C.A./Diploma holders) may be considered if they have significant experience and exceptional skills.

Technical Skills:

Proficient in Python, SQL, and NoSQL databases.

Extensive experience with ETL processes and cloud platforms (preferably AWS).

Familiarity with basic server knowledge and management.

Soft Skills:

Strong analytical and problem-solving abilities.

Excellent communication and collaboration skills.

Ability to work independently and in a team environment.

Experience

Minimum of 4 years of hands-on experience in data engineering, data analysis, or related fields, with a proven track record of delivering scalable data solutions.

Why Join Us?

At PriceIntelGuru, we are committed to fostering a culture of innovation, collaboration, and continuous growth. If you are passionate about leveraging data to drive business success and want to be part of a dynamic team, we encourage you to apply!