Full Time
up to 100,000 php
40
Jun 24, 2024
Position: Data Engineer
Location: Remote
Company: Bluedrive IT Services FZCO
Type: Full-Time
Job Summary: As a Data Engineer at Bluedrive IT Services FZCO, you will be responsible for designing, building, and maintaining scalable data pipelines and data warehouses. You will work closely with data scientists, analysts, and other stakeholders to ensure data is accessible, accurate, and ready for analysis.
Key Responsibilities:
Design, develop, and optimize data pipelines for the collection, storage, processing, and analysis of large data sets.
Build and maintain data warehouses, ensuring data integrity, security, and scalability.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
Implement and manage ETL (Extract, Transform, Load) processes to ensure timely and accurate data availability.
Monitor and troubleshoot data pipeline performance and reliability, addressing issues as they arise.
Develop and enforce data quality and governance standards across the organization.
Stay up-to-date with emerging technologies and best practices in data engineering and apply them as appropriate.
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
Proven experience as a Data Engineer or in a similar role.
Proficiency in SQL and experience with database management systems such as MySQL, PostgreSQL, or Oracle.
Experience with data warehousing solutions like Amazon Redshift and Snowflake.
Familiarity with ETL tools and processes (e.g., Apache Airflow, Talend, Informatica).
Strong programming skills in languages such as Python, Java, or Scala.
Experience with big data technologies like Hadoop, Spark, or Kafka.
Knowledge of cloud platforms (AWS, GCP, Azure) and their data services.
Containerization: Technologies like Docker and container orchestration tools for deploying and managing data engineering applications.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Preferred Qualifications:
Master’s degree in a related field.
Experience with data modeling and schema design.
Familiarity with data visualization tools (e.g., Tableau, Power BI).
Understanding of machine learning concepts and their application in data pipelines.
What We Offer:
Competitive salary and benefits package.
Opportunities for professional growth and development.
A collaborative and innovative work environment.
The chance to work with cutting-edge technologies and data solutions.