Job Information
Shell Associate Engineer - DataDoc Mgmt in Chennai, India
Where you fit
The Data Engineer will be part of the Asset Information Desk. The role will focus on building and maintain data quality in the Site’s IT systems and support changes to data in those systems.
The role will be part of the extended asset team supporting the LNG Canada (LNGC) Asset. This will be a key role in the IM space and needs to grow and evolve with the asset (from the project stage to steady state operations). The key aspect for this role in the first 2-3 years is working collaboratively with the LNGC team in executing the preparatory work to meet asset startup objectives.
We are seeking an experienced and highly skilled Data Engineer to provide remote support for the LNGC Digitalization team
In this role, you will be responsible for designing, developing, and implementing scalable and secure data pipelines, as well as maintaining the performance and availability of our databases, and operationalizing data environments also to develop the data quality measuring protocols to support project to asset handover and to support the implementation of the Information Management Quality System for the asset.
What's the role?
Your primary responsibilities will be:
Configuring Azure environments and resources to be used for data engineering
Designing and implementing data ingestion pipelines from multiple sources using Azure Data Factory and Databricks
Developing and maintaining data pipelines, data integrations, and data warehousing solutions
MLOps and workflow management in GitHub, Azure and Databricks.
Working with event based / streaming technologies (ex: SSIP) to ingest and process data
Managing secure access to data sets for the business
The role requires expertise in working with large volumes of structured and unstructured data & documents across multiple applications.
Coaching and Mentoring teammates to use core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW, and other related technologies)
Lead the delivery of short- and medium-term value opportunities related to data engineering scope
Planning reasonable and realistic project timelines and obtain agreement with Asset Partners.
Working collaboratively with the team, who are responsible for managing and delivering data and analytics solutions
Exploring ways to enhance data quality and reliability
Familiarity with establishing and maintaining Data Extract-Transform-Load processes and all the necessary tool and data enablers such as datalake, Altreyx ETL.
Develop Dashboards and reports on the current status of data quality/QA-QC across the different systems aligned with the project to asset block handover sequence.
Develop Data Quality reporting for the identified data groups together with the Data Value Owners.
Support the maintenance of asset related data as result of Management of Change through providing data-document consistency reports and MOC process efficiency metrics.
Other back up accountabilities:
Understand how information and data is utilized within the site or location through awareness to extract and apply the methods of these tools to Data Quality (methods and processes are listed in the Skills Section).
Assist the team leads to standardize processes, tools, methods, procedures as directed (Ex: Improving the data quality standards and best practices).
Key Challenges and Opportunities:
Working in a virtual environment and managing engagement across different levels of stakeholders.
Strong proficiency in using English for both spoken and written communication.
This will be a new role for LNGC and therefore will have some ambiguity. There will be an opportunity to leverage your expertise to recommend best practices and work autonomously.
Sound understanding of business/process workflow and having mature mindset to deal with challenging situations.
A self-starter leader and reliable deliverer, with very good verbal and written skills in English.
Exposes the individual to all cultural backgrounds and organizational levels across the globe, across diverse time-zones.