About BNP Paribas India Solutions:
Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.
About BNP Paribas Group:
BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialised businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability
Commitment to Diversity and Inclusion
At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.
Position Purpose
The Senior Developer will be a part of the ISPL Chennai – IHC ETL projects team. The developer position will primarily work on Apache Spark(python), Spark SQL, ETL tools, Unix, Autosys and DB
Responsibilities
Direct Responsibilities
- Expertise on PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
- Must have excellent knowledge in Apache Spark and Python programming experience.
- Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment, and loading into target data destinations.
- Experience in deployment and operationalizing the code, knowledge of scheduling tools like Airflow, Control-M etc. is preferred.
- Understanding of Unix/Linux + Shell Scripting
- Data modeling experience using advanced statistical analysis, unstructured data processing.
- Hands-on project experience on Jupyter Notebook/ Zeppelin/ PyCharm etc. IDEs
- Hands-on experience with AWS S3 Filesystem operations
Contributing Responsibilities
- Good knowledge of Hadoop, Hive, and Cloudera/ Hortonworks Data Platform
- Strong hands-on experience in Processing Framework - Spark 2.x/3.x (Core, Spark SQL, Streaming) Language & Package - Python (Scripting & PySpark), Unix Shell, SQL Query (basic & advanced)
- Expertise in RDBM solutions (Postgres & Oracle) and NoSQL Databases
- Knowledge on Streaming Platform – Apache Kafka, Spark Streaming
- Extensive hands-on experience in designing, building, and executing data pipeline using ETL/ELT tools.
- Big Data Hadoop - Detailed Knowledge on HDP/CDH Migration to new Cloudera CDP platform Data Storage – HDFS (File Format – Parquet, ORC, Avro, JSON), Hive (Schema, Partitioning), Data Lake (Object Store)
- Optimize and troubleshoot existing PySpark applications for performance improvements.
Technical & Behavioral Competencies
• Minimum 5 years hands-on experience with PySpark, Kubernetes, Docker
• Strong technical expertise in PySpark, Kubernetes, Docker and be in position to handle all technical difficulties
• Strong in designing (data warehousing) concepts.
• Good working knowledge in Unix/Ubuntu (Should be able to write wrapper scripts)
• Capable of tuning the code to handle the huge data volume.
• Responsible for translating/understanding the functional requirements to meet the specified technical requirements.
• Rich experience involved in testing the PySpark modules, plans, deploys, and tests the ETL mappings, etc., to ensure that the clients remain satisfied
• Involved in coding, testing, implementing, debugging, and documenting the complex programs.
• Involved in creating proper technical documentation in the work assignments.
• Understand the business needs and designs programs and systems that match the complex business requirements and records all the specifications that are involved in the development and coding process.
• Ensures that all the standard requirements have been met and is involved in performing the technical analysis.
• Responsible for assisting the project manager by compiling information from the current systems, analyzing the program requirements and ensuring that it meets the specified time requirements.
• Resolves moderate problems associated with the designed programs and provides technical guidance on complex programming.
Behavioral Competencies
• Excellent verbal and written communication skills.
• Conduct meetings with global stakeholders, prepare minutes & summaries.
• Assertiveness, Negotiation, Proactiveness & Prioritization skills are important.
• Discipline in documenting, following up on issues and changes.
• Experience in interacting with global stakeholders and independently managing discussions.
Specific Qualifications (if required)
Skills Referential
Behavioural Skills: (Please select up to 4 skills)
Communication skills - oral & written
Ability to synthetize / simplify
Attention to detail / rigor
Organizational skills
Transversal Skills: (Please select up to 5 skills)
Analytical Ability
Ability to understand, explain and support change
Ability to develop and adapt a process
Ability to manage / facilitate a meeting, seminar, committee, training…
Ability to develop and leverage networks
Education Level:
Bachelor Degree or equivalent
Experience Level
At least 5 years
Other/Specific Qualifications (if required)
Additional knowledge on reporting tools is advantage
