- Work with challenging tasks to maintain data that helps our clients gain insights on various aspects of our system.
- Work on our data platform to enable building and delivering large datasets to final clients.
- Collaborate with the back-end team to ensure smooth data pipelines and processing.
- Work with data extraction services and build tools for it.
- Build data models and implement necessary modifications.
- Understand big data processing principles.
- Design, implement, manage, test, monitor, and optimize our data platforms to meet the data pipeline needs.
- Identify incomplete data, improve the quality of data, and integrate data from several data sources.Your skills & experience:
- Experience building data pipelines using cloud service providers such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP).
- Strong experience using any of the cloud providers. We use GCP ideally would like GCP but AWS and Azure would be also valid.
- Experience with Apache Spark and/or its Python libraries.
- Knowledge of ETL/ELT pipeline design for semi-structured data (both batch and real-time), development and maintenance using SQL and/or Python.
- Experience with SQL and NoSQL approaches to database design for evolving schemas, preferably in context of a large data lake or data warehouse (e.g. Google Cloud Storage/Google BigQuery), optimized for either storage or retrieval.
- Experience setting up and maintaining scheduled data processing orchestration (e.g. Airflow, Dagster).
- Experience developing and maintaining the infrastructure and tools around the data pipeline is highly desirable (e.g. managing AWS resources via Terraform, setting up CI/CD, maintaining a Kubernetes cluster).
NICE TO HAVE: - Experience working with dbt and Great Expectations is a plus.
- Experience working with or implementing Data Catalogs is a plus.
- Experience with REST API development is a plus.
- Experience with any of the messaging systems (such as Pub/Sub, RabbitMQ, AWS Kinesis or Apache Kafka) is a plus.
Don't hesitate to apply even if you missed some of the criteriaSalary:
- Gross salary EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competences.
Up for the challenge? Let's talk
-
Senior Data Engineer
Rasta: beBee S2 LT - prieš 2 dienas
Telia Vilnius, Lietuva Visą darbo dienąSenior Data Engineer (For Norway). Telia offers job. Senior Data Engineer Ready to make better happen? We are expanding the Data Analytics. ...
-
Data Platform Engineer
Rasta: beBee S2 LT - prieš 5 dienas
Telia Vilnius, Lietuva Visą darbo dienąData Platform Engineer (Cloud). Telia offers job. Data Platform Engineer (Cloud) Ready to make better happen? I am Augustas Degutis,. ...
-
Senior Data Engineer
Rasta: beBee S2 LT - prieš 7 valandas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access ...
-
Mid/Senior Data Engineer
Rasta: beBee S2 LT - prieš 2 dienas
Telia Vilnius, Lietuva Visą darbo dienąMid/Senior Data Engineer (For Revenue Assurance). Telia offers job. Data Engineer Have you already heard of Data Analytic Hub at Telia Global Services. ...
-
GenAI Data Engineer in Vilnius
Rasta: beBee S2 LT - prieš 4 dienas
Danske Bank A/S Lietuvos filialas Vilnius, Lietuva Visą darbo dienąGenAI Data Engineer. Danske Bank A/S Lietuvos filialas offers job. Area Would you like to join our Tech Strategy unit working with Generative AI in. ...
-
Senior Big Data Engineer in Vilnius
Rasta: beBee S2 LT - prieš 1 dieną
Danske Bank A/S Lietuvos filialas Vilnius, Lietuva Visą darbo dienąSenior Big Data Engineer. Danske Bank A/S Lietuvos filialas offers job. Area We believe taking risks is crucial in banking, and we' re committed to. ...
-
Chief Engineer in Data Platform Tribe in Vilnius
Rasta: beBee S2 LT - prieš 3 dienas
Danske Bank A/S Lietuvos filialas Vilnius, Lietuva Visą darbo dienąChief Engineer in Data Platform Tribe. Danske Bank A/S Lietuvos filialas offers job. Area Would you like to be part of Data & Analytics and play an important role. ...
-
Data Engineering Chapter Lead for Risk and Compliance Tribe in Vilnius
Rasta: beBee S2 LT - prieš 6 dienas
Danske Bank A/S Lietuvos filialas Vilnius, Lietuva Visą darbo dienąData Engineering Chapter Lead for Risk and Compliance Tribe. Danske Bank A/S Lietuvos filialas offers job. Area We believe taking risks is crucial in banking, and we're committed to changing. ...
-
IT Architect
Rasta: Appcast US A2 - prieš 5 dienas
Cencora Vilnius, Lietuva Visą darbo dienąCencora, previously known as AmerisourceBergen, is a leading global pharmaceutical solutions organization centered on improving lives. Ranked #21 on the Global Fortune 500, our team members are united in our responsibility to create healthier futures. · Our Shared Service Center ...
-
Project Manager III
Rasta: Appcast US A2 - prieš 5 dienas
Cencora Vilnius, Lietuva Visą darbo dienąCencora, previously known as AmerisourceBergen, is a leading global pharmaceutical solutions organization centered on improving lives. Ranked #21 on the Global Fortune 500, our team members are united in our responsibility to create healthier futures. · Our Shared Service Center ...
-
Mid-Senior DevOps Engineer
Rasta: beBee S2 LT - prieš 6 dienas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access ...
-
Software Engineering Team Lead in Vilnius
Rasta: beBee S2 LT - prieš 1 dieną
Alliance for Recruitment Vilnius, Lietuva Visą darbo dienąSoftware Engineering Team Lead. Alliance for Recruitment offers job. ABOUT THE PROJECT: OAG is in the process of creating a new generation data platform. ...
-
Manual QA Specialist
Rasta: beBee S2 LT - prieš 4 dienas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access ...
-
Senior Cloud Engineer
Rasta: beBee S2 LT - prieš 7 valandas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access ...
-
Senior Machine Learning Engineer
Rasta: Manatal GBL S2 T2 - prieš 1 dieną
AIDA projektai, MB Vilnius, LietuvaWe are seeking a skilled Machine Learning Engineer for our client. · The ideal candidate will have proficiency in Python for rapid prototyping and algorithm development, as well as experience with common vision and machine learning frameworks such as TensorFlow, OpenCV, and PyTor ...
-
Sales Executive
Rasta: beBee S2 LT - prieš 2 dienas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access ...
-
Customer Success Manager
Rasta: beBee S2 LT - prieš 4 dienas
Oxylabs Vilnius, Lietuva Visą darbo dienąWe are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering.More than a year ago Oxylabs announced the acquisition of Webshare Software Company, a distinguished Silicon Valley-based ...
-
Validation Engineer
Rasta: beBee S2 LT - prieš 19 valandų
Teva Pharmaceuticals Vilnius, LietuvaWho we are · Together, we're on a mission to make good health more affordable and accessible, to help millions around the world enjoy healthier lives. It's a mission that bonds our people across nearly 60 countries and a rich, diverse variety of nationalities and backgrounds. Wor ...
-
Product Management Specialist III
Rasta: beBee S2 LT - prieš 5 dienas
Thermo Fisher Scientific Vilnius, Lietuva Visą darbo dienąJob Description · Job Description · Summary · Our Mission is to enable our customers to make the world healthier, cleaner and safer. Watch as our colleagues explain 5 reasons to work with us. As one team of 100,000+ colleagues, we share a common set of values - Integrity, Intensi ...
Data Engineer - Vilnius, Lietuva - Oxylabs
Aprašymas
We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone can grow and thrive.
Here's how our Data Team describes this position:
If you joined this team, you would be solving our clients' most ambitious challenges - as we are reaching towards being one of the first data extraction services
We value people hungry for knowledge and eager to apply it, and in return, we provide a constantly evolving environment rich with challenges that we solve with the latest technologies and greatest ideas. We have a seat ready for you
Your day-to-day: