Rodrigo Lazarini Gil – Medium

Rodrigo Lazarini Gil

Rodrigo Lazarini Gil

Why (and how) I use poetry for python package management

I always remember to write about this when I hear someone in a meeting complaining about some broken package in python.

3 min readMar 20, 2021

--

Why (and how) I use poetry for python package management

--

Rodrigo Lazarini Gil

Pyspark image with jobs syncing through git

Anytime we want to trigger a spark job, we also need to deploy our jar package, or in pyspark case, our zip package to be executed.

1 min readJan 27, 2021

--

Pyspark image with jobs syncing through git

--

Rodrigo Lazarini Gil

Criando e customizando sua imagem pyspark

Sempre quis uma imagem docker oficial para rodar alguns jobs locais, rodar uns testes e usar para meus projetos.

1 min readJan 27, 2021

--

Criando e customizando sua imagem pyspark

--

Rodrigo Lazarini Gil

Creating and customizing your pyspark image

I’ve always wanted an official spark docker to run local jobs, run some tests and prepare to deploy these in my projects.

1 min readDec 28, 2020

--

Creating and customizing your pyspark image

--

Rodrigo Lazarini Gil
in
Tech@Grupo ZAP

Airflow com Dags em YAML Dags e kubernetes operator

Simplificando a criação de DAGs

4 min readMay 14, 2020

--

Airflow com Dags em YAML Dags e kubernetes operator

--

Rodrigo Lazarini Gil

Airflow with YAML Dags and kubernetes operator

Simplifying the creation of DAGs

4 min readApr 28, 2020

--

Airflow with YAML Dags and kubernetes operator

--

Rodrigo Lazarini Gil
in
Tech@Grupo ZAP

Airflow escalável com Kubernetes + Git Sync

Usando airflow para prover uma solução para múltiplos times

4 min readJan 21, 2020

--

1

Airflow escalável com Kubernetes + Git Sync

--

1

Rodrigo Lazarini Gil

Scalable airflow with Kubernetes + Git Sync

A simplified use of airflow to provide a solution for multiple teams

4 min readJan 21, 2020

--

1

Scalable airflow with Kubernetes + Git Sync

--

1

Rodrigo Lazarini Gil

Luigi: Running one task multiples times

I started working with Luigi only a few weeks ago. I understood the basics and felt like trying it in a data warehouse project to link all…

2 min readFeb 12, 2018

--

Luigi: Running one task multiples times

--

Rodrigo Lazarini Gil

Rodrigo Lazarini Gil

Working through the years with SQL, data modeling, data platform and engineering. Currently focused on data platform and spark jobs with python.

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams