This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engenheiro de Dados AWS Sênior - Databricks based in Brazil.
As a Senior AWS Data Engineer specializing in Databricks, you will play a key role in designing, building, and optimizing modern data platforms that support critical business and regulatory processes. Working in a highly collaborative and innovation-driven environment, you will lead complex data engineering initiatives, helping transform raw information into reliable, scalable, and actionable assets. This role offers the opportunity to work with cutting-edge cloud technologies, large-scale data architectures, and cross-functional teams. You will contribute to strategic technical decisions while ensuring the highest standards of data quality, governance, and performance. Ideal candidates combine strong technical expertise with problem-solving skills and a passion for delivering impactful data solutions. This is an excellent opportunity to influence enterprise-level data ecosystems while advancing your career in a cloud-first environment.
Accountabilities:
- Analyze and map data sources, identifying structures, relationships, business rules, and integration requirements.
- Lead the migration of raw and legacy data into Databricks environments, ensuring data integrity, traceability, and quality throughout the process.
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Delta Lake, Python, SQL, and AWS services.
- Implement business rules and data transformations required to support operational and regulatory reporting processes.
- Build, validate, and optimize regulatory reports while ensuring compliance with established standards, controls, and deadlines.
- Contribute to data architecture decisions and support the design of modern cloud-based data solutions within the AWS and Databricks ecosystem.
- Ensure compliance with governance, security, privacy, and data quality standards across all stages of the data lifecycle.
- Troubleshoot and resolve complex technical issues related to data platforms, pipelines, and cloud infrastructure.
- Provide technical leadership, mentoring, and knowledge sharing to less experienced team members.
- Collaborate closely with business stakeholders, regulatory teams, and multidisciplinary technical teams to deliver high-quality solutions.
Requirements
- 4+ years of professional experience in Data Engineering, including proven experience in senior-level roles.
- Strong hands-on experience with Databricks, preferably with at least 3 years working on enterprise-scale implementations.
- Advanced knowledge of AWS cloud services and Databricks integration within AWS environments.
- Solid expertise in data modeling, Delta Lake architecture, data warehousing concepts, and ETL/ELT processes.
- Advanced proficiency in Python and SQL for large-scale data processing and transformation.
- Experience designing and implementing distributed data architectures and high-performance processing pipelines.
- Practical experience with data mapping, migration projects, and integration of legacy or heterogeneous data sources.
- Ability to independently lead end-to-end technical deliveries and make sound architectural and engineering decisions.
- Strong focus on scalability, performance optimization, governance, security, and data quality.
- Excellent communication, collaboration, and stakeholder management skills.
- Strong analytical thinking and problem-solving capabilities in complex technical environments.
Preferred Qualifications
- Experience supporting regulatory reporting initiatives for financial institutions, including BACEN-related requirements.
- Previous experience within the banking, financial services, or regulated industries sector.
- Databricks certifications, such as Databricks Certified Data Engineer Associate or Professional.
- Familiarity with DevOps practices, infrastructure automation, and CI/CD pipelines.
- Experience with data visualization and business intelligence tools such as Power BI or MicroStrategy.
- Knowledge of Agile delivery frameworks, including Scrum and Kanban.
- Experience mentoring junior and mid-level data professionals.
Benefits
- Comprehensive medical insurance coverage for employees and eligible dependents.
- Dental insurance plan for employees and family members.
- Profit Sharing Program (PLR).
- Childcare assistance program.
- Meal and food allowance.
- Home office allowance to support remote work productivity.
- Educational partnerships offering discounts on courses, certifications, and degree programs.
- Financial support and incentives for professional certifications, including cloud technologies such as AWS, Azure, and GCP.
- Livelo rewards points program.
- Access to wellness and fitness programs through TotalPass.
- Mental wellness and mindfulness support programs.
- Collaborative and innovation-focused work environment.
- Continuous learning and professional development opportunities.
- Exposure to modern cloud, data engineering, and analytics technologies.
- Inclusive workplace committed to diversity and equal opportunities.