Job Title: Engineer – IT Factory - Python Data Engineer
Department: IT Factory
About Business line/Function: The IT factories team is responsible for building and maintaining applications that support information system steering. A new application is being developed for user entitlement controls, execution and management.
Position Purpose:
We are looking for a python data engineer, to own the data foundation of the application. As every control result, every dashboard figure and every application screen reads from the curated data model you build and maintain. If the data is wrong, late or unexplained, nothing above it can be trusted.
The platform ingests from several enterprise sources into a raw layer that preserves exactly what each source sent and then transforms that into a curated model. You will build and operate the data pipelines, implement the reconciliation and data-quality checks that prove each load is complete, and extend the model as new controls and modules require it.
You will also implement the control rules themselves. These are written primarily as versioned SQL against the curated model, reviewed like application code, and executed by the controls engine. This is where data engineering meets the business purpose of the platform, and it is a significant part of the role.
This is not a pure pipeline role. You will also contribute to the application services, and you are expected to be able to pick up backend work when delivery requires it.
Responsibilities
Direct Responsibilities
- Ingestion pipelines — scheduled extraction from enterprise source systems into the raw layer, including change detection, load history and the recording of source data provenance.
- The curated data model — transformation from raw to a conformed, keyed and de-duplicated model of entitlements, applications, users and their relationships.
- Reconciliation and data quality — checks that prove each load is complete and consistent, with results written to an append-only evidence store and discrepancies raised rather than silently absorbed.
- Pipeline orchestration — scheduling, dependency management, retry and alerting, with a run history that can be interrogated when a question is asked about a past load.
- Control rules as code — the rule base for the control catalogue, written as versioned SQL with accompanying metadata, peer-reviewed and promoted through the same pipeline as application code.
- Reporting data layer — the curated views that the reporting dashboards consume, designed as a stable contract that survives changes to the underlying model.
- Backend services — contributing to the Python application services alongside the Technical Lead.
Technical & Behavioral Competencies
- Autonomy & Ownership: Ability to work autonomously and take end-to-end ownership of backend components
- Industry Expertise: Experience in large-scale regulated enterprise environments (banking/financial services preferred)
- Collaboration & Communication: Strong collaborative and communication skills to work in a global team
Specific Qualifications:
Technical Skills:
- SQL, at depth. This is the core of the role. Complex joins, aggregation, window functions, set operations; reading and acting on query plans; indexing and performance tuning on large tables. You should instinctively solve a data problem in SQL before reaching for application code.
- Relational data modelling. Designing schemas for analytical and operational use: keys, grain, slowly changing data, handling of deletions and deactivations in source systems. PostgreSQL experience preferred.
- Python for data engineering. Writing maintainable, tested Python for ETL — not notebooks. Experience with SQLAlchemy or a comparable toolkit, and with pandas or Polars for in-flight transformation.
- Pipeline construction and operation. Building pipelines that run unattended: idempotent loads, failure handling, retries, alerting and the ability to re-run a failed load safely.
- Data quality and reconciliation. Practical experience proving that a data load is complete and correct, and designing the controls that detect when it is not.
- Backend development. Sufficient experience building API services in Python — FastAPI, Django or Flask — to contribute to the application layer.
- Testing discipline. Automated tests for transformation logic. Experience with pytest.
- Version control. Disciplined use of Git and pull request review. Treating SQL and pipeline definitions as code, held in a repository rather than on a server.
- Communication in a distributed team. Clear written English, and the judgement to flag a data discrepancy rather than work around it.
Nice to have:
- Workflow orchestration — Apache Airflow in production, or an enterprise scheduler such as Control-M or Autosys.
- Identity and access management domain knowledge — entitlements, roles, functional role codes, segregation of duties, or experience with an IAM platform such as SailPoint.
- Reporting tools — Power BI, including semantic modelling and designing the views that sit behind a dashboard.
- Regulated-environment experience — working with personal or otherwise sensitive data under data-protection controls, including masking of non-production environments.
- Linux and CI/CD — comfortable deploying and troubleshooting on Linux servers with an automated pipeline.
Education Level: Bachelor of Engineering or equivalent.
Location: Mumbai
About BNP Paribas Group:
BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialized businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability.
About BNP Paribas India Solutions:
Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.
Commitment to Diversity and Inclusion
At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.
