Descrição:
About the job Senior AWS Data Engineer
Job Title: Senior AWS Data Engineer
Location: Lisbon, Portugal
Work Regime: Full-time & Hybrid (2x office)
Step into a dynamic ecosystem where the future of business is created and lived every day. Be part of it!
At LUZA Group, passion, perseverance, and the drive to excel define our path to success.
Founded in 2006, we are a Portuguese multinational with over 1,200 talented professionals and a turnover surpassing 30M. With a strong presence in key marketsPortugal, Spain, Morocco, Brazil, Mexico, the United States, and Chinawe deliver innovative solutions in engineering, IT, design, consulting, Industry 4.0, training, and recruitment. Our people and their talent power everything we do.
This is a moment of growth and opportunity. The future belongs to visionary minds. Will you join us?
Overview / Summary:
We're seeking a Senior Data Engineer to drive cloud-native data pipeline development within our AWS and Snowflake environments. This role demands a strong foundation in data architecture and modeling, coupled with the ability to build high-performance data solutions that directly support our strategic business goals. You'll integrate into a product's Scrum team, collaborating closely with data analysts and internal stakeholders to ensure seamless delivery and operational excellence, aligning with sprint objectives.
Responsibilities and Tasks:
- Design and deploy robust, cloud-based data pipelines to efficiently transform diverse raw data sources (APIs, FTP, SFTP) into structured, actionable formats.
- Architect and implement high-performance, scalable data pipelines (batch and streaming) with comprehensive monitoring and alerting systems for data analysts and business users.
- Curate and manage large, complex datasets, ensuring they meet both functional and non-functional business requirements.
- Contribute to data governance initiatives through meticulous metadata cataloging and documentation.
- Implement rigorous functional and non-functional data testing protocols.
- Develop sophisticated data models and design optimized database objects (views, tables, procedures, scripts).
- Conduct in-depth query analysis and optimization for performance and scalability.
- Actively participate in troubleshooting, monitoring, and user support, ensuring uninterrupted data operations.
- Collaborate seamlessly with cross-functional teams to gather requirements and deliver effective data solutions.
- Adhere to established architectural guidelines, driving improvements in data product scalability and performance.
- Stay abreast of emerging industry trends and technologies to enhance data engineering practices.
Required Qualifications:
- Bachelors degree in Engineering or a related field.
- Extensive experience in data pipelining and AWS services (S3, ECS, Lambda, RDS, SNS/SQS, IAM, CloudWatch).
- Proven expertise in analytical database programming (SQL) and unstructured/graph databases.
- Advanced SQL query writing skills; DBT core proficiency is a plus.
- Proficiency in Python and data libraries (Pandas, Boto3).
- Strong understanding of data platform architecture and data governance.
Preferred Qualifications:
- Deep expertise in Snowflake development.
- Experience with CI/CD implementation.
- Proficiency with orchestration tools (Step Functions, Airflow, Prefect).
- Experience with version control (GitHub, GitLab).
- Knowledge of data visualization tools (Tableau).
- Experience with Infrastructure as Code (CloudFormation, Terraform).
- AWS or Snowflake certifications (Solution Architect, SnowPro Core).
#VisionaryFuture - Build the future, join our living ecosystem!