Sr. Data Engineer (3-6 years, Java/Python, Spark & Hadoop)

Visa · IN - Bengaluru, India

About Us
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

We at Visa, dream of a future where it's easy to pay and be paid. Across the planet, Wherever, Whenever, Securely and Easily. Together, we are building leading edge full-service Payment Management solutions combining global payment processing, fraud management and payment security systems. We are looking for a talented Sr. Data Engineer to join our team!

The Sr. Data Engineer will play a pivotal role in Risk and Identity Solutions (VAS) department. In this mission critical role, it's an opportunity to design and implement solutions and taking it to the production with high quality completing all phases, following an agile methodology. The responsibilities also include gathering and clarifying requirements, facilitating communication with other groups within the organization, and guiding architectural decisions. It is an opportunity to learn, lead and work on technologies for RAIS applications.

Key Responsibilities:

  • Collaborate proactively with stakeholders to clarify requirements and identify key product stakeholders.
  • Review technical requirements, escalate potential design issues, and create component designs and documentation.
  • Implement code, apply coding patterns and best practices, and adhere to security requirements.
  • Participate in code reviews, apply feedback, and take ownership of data products or pipeline components.
  • Conduct unit testing, coding standards, and security scans; participate in user acceptance testing.
  • Build tools and simple automation processes for transforming, managing, accessing, deploying, and monitoring data processes.
  • Create queries to extract and compile raw data, implement orchestration techniques, and validate data quality.
  • Ensure adherence to data management principles, governance, and performance monitoring protocols.
  • Contribute to troubleshooting guidance and procedures for reviewing and fixing problems flagged by testing.
  • Address routine client requests requiring technical knowledge and support software upgrades and server patches for security remediation.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

  • 3-6 years of relevant work experience and a Bachelor's degree or with an Advanced degree.
  • Experience in collaborating with cross-functional teams to clarify requirements and define technical solutions.
  • Experience in designing and documenting technical components for data products or pipelines.
  • Experience in implementing code and applying coding standards and security requirements.
  • Experience in conducting unit testing and participating in user acceptance testing.
  • Experience in building automation tools for data processes.
  • Experience in creating queries and implementing data extraction and transformation techniques.
  • Experience in ensuring data quality and performance monitoring.
  • Experience in troubleshooting and resolving pipeline issues.
  • Experience in supporting software upgrades and security remediation.


Preferred Qualifications:

  • 3-6 or more years of work experience with a Bachelor’s Degree or with an Advanced Degree
  • Solid experience in software development experience (with a concentration in data centric initiatives) in technology industry with strong programming skills
  •  Solid hands-on experience with Data technologies like Java (must), Spark, Flink, Hive Queries, Scoop, Scala, Hadoop
  • Strong expertise in Java and Spring Framework , Web services, J2EE is must
  •  Experience with highly distributed, scalable, concurrent and low latency systems working with one or more of the following database technologies: Oracle Server, Microsoft SQL Server, PostgreSQL server.
  • Good to have hands-on experience with scripting languages like Python/Shell Script

  • Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models.
  • Use of Gen AI tools for coding and knowledge would be must
  • Have a working expertise in building MCP tools and clients
  • Must have experience in a technical capacity and quality methodology/release process/testing techniques in order to provide guidance and leadership to junior team members is required.
  • Must have experience testing in an AGILE environment and should have exposure to testing environment migration, DB and infrastructure/system upgrades.
  •  Continuous Integration, Code/Test coverage working in different methodologies is a plus
  • Must have proactive and strong communications to work well across teams.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Apply →