Oferta pracy Data Engineer (Lufthansa Technik), Gdańsk

Expected, SQL, Databricks, Python, PySpark, Git, CI/CDOptional, Azure Data Factory, Azure SynapseOperating system, WindowsAbout the project, Lufthansa Systems Poland supports Data Engineering project for Lufthansa Technik. The scope of this project is as follows:, 1. Ingest data into central data platform, Ingest data from various internal and external data sources into the common landing zone of the platform. Knowledge about these sources, the platform toolset (Azure stack) and modern data architectures, as well as accompanying principles (SCD, Delta files, …) is necessary., 2. Create new data objects along business use cases, Based on data available on the central platform, new data objects are created. This includes to basically the same toolset as in the ingestion scenario, but requires also the understanding of the business – to a certain degree. Tasks: build data models, define interfaces, create data flows/pipelines and quality checks., 3. Maintain and operate existing data objects, Ongoing support, development and maintenance of existing data objects., The data engineers working in this project are responsible for:, -gathering and analyzing business requirements and expectations,, -finding relation between business requirements and existing data model,, -identification of new necessary data sources based on business requirements,, -providing proof-of-concepts in cooperation with business,, -planning of the stories and tasks including estimations for the realization of the identified requirements,, -implementing new functionalities based on gathered and analyzed requirements,, -developing changes and improvements in the existing processes,, -analysis of exceptional data configurations,, -implementation of import and export processes into and from the data warehouse,, -constant documentation of the particular steps and the final product.Your responsibilities, Analyze business requirements in the area of Data Engineering,, Analyze issues related to inappropriate data,, Propose technical solution in the form of new or changed database structures and processes,, Develop the proposed solution,, Prepare the development to the deployment,, Documentation maintenance.Commercial experience in Data Processing using : Azure data engineering technological stack ( Databricks, Data Factory, Synapse ), experience with PySpark, database procedural language ( for ex.: T-SQL, PL/SQL ),, Min. 2 years of experience in Data Engineering/Data Analytics/Data Processing,, Very good knowledge of SQL,, Knowledge of Version Control tools,, Good knowledge of English in speaking and writing (B2/C1),, Team player with good communication skills,, Readiness to work from the office in Gdańsk min. 2 days a week.Optional, Experience with ETL tools ( for ex.: Microsoft SSIS, Oracle ODI, Kettle ETL, Informatica ),, Database operations experience ( partitioning, index/statistics maintenance, performance analysis ),, General knowledge of Unix/Linux systems,, Knowledge about Agile/Scrum methodologies.Team size, 4-6This is how we work, in house, at the client's site, you focus on a single project at a time, you develop the code "from scratch", you focus on product development, agileDevelopment opportunities we offer, conferences in Poland, external training, intracompany training, mentoring, soft skills training, substantive support from technological leaders, support of IT events, technical knowledge exchange within the companyWhat we offer, An international working environment, atmosphere that stimulates development,, Individual career path,, Lufthansa Group membership benefits,, Flexible working time and place adjusted to employee’s needs. Possibility of starting your workday between 07:00 and 11:00,, Support for your passion for sports within the local activity group and co-financing Multisport cards,, Private medical care for employees and their family members.Benefits, sharing the costs of sports activities, private medical care, sharing the costs of professional training & courses, life insurance, flexible working time, fruits, corporate products and services at discounted prices, integration events, no dress code, coffee / tea, drinks, parking space for employees, leisure zone, extra social benefits, holiday funds, sharing the costs of holidays for kids, sharing the commuting costsLufthansa Systems, Lufthansa Systems Poland is acclaimed and widely recognized provider of superior services and IT solutions for the aeronautical, logistic and financial industries. As a part of the Lufthansa Group we implement technological solutions and dedicated services.This is how we work,