Data Cloud Platform Engineer - MAPFRE : Job Details

Do you think in Python and speak in SQL? Do you appreciate a good data model as much as a good painting in a museum? Are you excited by an opportunity to solve complex problems while also having fun? Are you a team player? Do you strive for simplicity and elegance in your solutions? If so, MAPFRE USA is looking for a data engineer who will be part of the Data Engineering team building data products for our sophisticated data consumers.

As a Data Engineer, you will be a part of an agile team delivering value using modern tools and technologies. You will work closely with the data architect and stakeholders to help MAPFRE USA transform into a data-driven organization.

• Must be a US Citizen or a Green Card holder
• This is a Hybrid schedule, onsite 3 days in the MAPFRE USA offices in Webster, Massachusetts

Job Summary

• Augment and maintain the existing repositories and data structures within AWS (used to process and store large amounts of data from unrelated sources)
• Experience with several formats and means for data ingestion, including data types (structured, semi-structured, and unstructured) and sources (on-premise and in the cloud) using the most appropriate techniques in each case
• Continue to expand and enhance the model, utilizing best practices regarding the organization of data and the various relationships
• Optimize existing and future models for fast and scalable queries (while maintaining performance and related price thresholds)
• Work with the team to define, construct, and maintain self-service dashboards for the Business and Advanced Analytics teams within PowerBI
• Implement scalable and flexible, high-performance data pipelines for AWS to support analytics
• Develop and maintain data maps and their relationships
• Generate associated technical documentation including follow-up reports
• Work with Data Governance to implement quality rules and data governance measures (data dictionary, metadata, traceability, ...)
• Propose improvements and actions based on provided results
• Communicate results effectively with required teams

Knowledge, Skills and Abilities:

• Bachelor's Degree with 6+ years of experience
• Advanced knowledge and experience using Python, Airflow, Spark, AWS, and Snowflake
• CI/CD and Orchestration: Jira, Jenkins, Bit Bucket, Terraform, and Airflow
• Past experience with data modeling tools and ETL tools (e.g., Informatica Power Center)
• Computer languages and data query and transformation tools: AWS Athena, Jupyter notebooks, Spark, Pyspark, Python, and EMR Studio
• Algorithm analysis (for working with our Data Scientists)
• Understanding of multidimensional modeling for quantitative and fact-related data storage
• OS: Linux and MS Windows
• Code IDE: Microsoft Visual Code, Jupyter notebooks
• Artificial intelligence, machine learning, and deep learning are a plus