AWS Data Engineer - Energy Project
About Qualysoft
· 25 years of experience in software engineering, established in Vienna, Austria
· Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B)
· Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development
· We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms
· Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech
· Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia
· International team of 500+ software engineers
· Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner
· Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation.
· Project beneficiaries ranging from large-scale enterprises to startups
· Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions
· Quality-first mindset, culture of innovation, and long-term client partnerships
· Global and local reach – trusted by key industry players in Europe and the US
Responsibilities:
• Design and implement Big Data Architecture
• Work with the application development team to implement data strategies, build data flows.
• Develop data pipelines from injection to reporting
• Analyze data sets and design new ways to valorize them
• Work with analysts to collect and define analytics data needs, build technical specifications
• Design, build and manage data catalog / dictionary
• Work with the application development team to implement data strategies, build data flows.
• Develop data pipelines from injection to reporting
• Analyze data sets and design new ways to valorize them
• Work with analysts to collect and define analytics data needs, build technical specifications
• Design, build and manage data catalog / dictionary
Qualifications:
• Experience in designing Big Data Solutions
• In depth experience of apache Airflow
• In depth experience in py-spark development
• In depth experience in data processing and data models
• Experience with AWS Redshift or similar
• Experience with Cloudera or HDFS based products
• Experience with ETL flows
• Experience with Data steaming (kafka)
• In depth experience of apache Airflow
• In depth experience in py-spark development
• In depth experience in data processing and data models
• Experience with AWS Redshift or similar
• Experience with Cloudera or HDFS based products
• Experience with ETL flows
• Experience with Data steaming (kafka)
Nice to have:
• Experience working with real time streaming.
• Experience in Sagemaker ML
• Experience with NIFI data flows
• Experience with INFORMATICA data flows
• CI/CD: GIT
• Experience in Sagemaker ML
• Experience with NIFI data flows
• Experience with INFORMATICA data flows
• CI/CD: GIT